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STATISTICAL TESTS OF CERTAIN RORSCHACH 
ASSUMPTIONS: THE INTERNAL CONSIS- 
TENCY OF SCORING CATEGORIES 


J. R. WITTENBORN 


YALE UNIVERSITY 


N the first publication of this series, 

Analyses of Discrete Responses 
[13], two reasons were given for ex- 
amining the implications of some of the 
Rorschach Assumptions: 

1. Since the assumptions have not 
been tested, the possibility exists that 
some of them are invalid. If some of the 
assumptions cannot be validated, as- 
pects of interpretations based on the 
questionable assumptions should be em- 
ployed with reservation or perhaps 
eliminated from standard procedures. 

2. Many of the assumptions em- 
ployed in Rorschach procedures cannot 
be found among the established facts 
and theories of American academic psy- 
chologists. If the Rorschach assump- 
tions are valid, their relevance to the 
psychology of personality organization 
and to the psychology of perception 
could be of extraordinary significance. 

In scoring a Rorschach protocol, it is 
customary to classify each response 
with respect to several classes of fac- 
tors, such as content, portion of ink 
blot interpreted, and ink blot character- 
istics determining the response. There 
are standard categories within each of 
the classes of factors. When a response 
is scored, the content category in which 
it falls, as well as its location category 
and its determinant category, is desig- 
nated by the scorer. As a second step 
in scoring, the total number of responses 
falling in each category is ascertained. 
Regardless of the precise manner in 
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which the categories are used, the de- 
vice of categorizing the responses and 
then finding the total number of re- 
sponses in each category carries two im- 
plications: 

I. That all of the responses falling 
in a given category are similar in some 
behavioral] respect. 

II. That the psychological signifi- 
cance of responses falling in a given 
category is different in some respect 
from responses placed in other categor- 
ies. 

These assumptions are implicit for 
example, in the distinction that is made 
between Human Movement and Color 
responses. This distinction was first 
emphasized by Rorschach [9], and its 
observance has remained a basic feature 
of Rorschach psychodiagnosis. Because 
of the basic significance ascribed to 
these two types of responses, it was de- 
cided to employ this distinction in test- 
ing the foregoing assumptions of intra- 
category similarity and intercategory 
difference. 

If Assumption I is a true proposition, 
it follows that several measurements of 
the tendency to perceive human move- 
ment would be positively related. If sev- 
eral measures of a given response cate- 
gory were not positively interrelated, 
it would be difficult to justify an as- 
sumption that differences in number of 
responses of that category expressed 
differences in a personality attribute. 
It also follows from Assumption IT that 








2 J. R. WITTENBORN 


several measures of a given response 
category would be more highly interre- 
lated with each other than they would 
be related with measures of some other 
category. 

The following experimental hypothe- 
ses have been tested by statistical anal- 
yses (A and B) of data provided by the 
Harrower-Erickson multiple choice 
check list [3], the analyses were based 
on asample of 247 undergraduates: 

A. The tendency for controlled Col- 
or responses (FC and CF) to be associ- 
ated with other controlled Color re- 
sponses (FC and CF) is greater than 
the tendency for such Color responses 
to be associated with Human Movement 
(M) responses. 

B. The tendency for Human Move- 
ment (M) responses to be associated 
with other Human Movement (M) re- 
sponses is greater than the tendency for 
such responses to be associated with 
controlled Color responses (FC and 
CF). 

C. The degree to which Rorschach 
responses will be intercorrelated is a 
function of the number of scoring cate- 
gories the responses have in common. 

The major conclusions of the Analy- 
ses (A and B) of the check list data 
may be stated as follows [13]: 

1. Among the intercorrelations be- 
tween pairs of discrete check list re- 
sponses there is no obvious pattern 
which conforms with a pattern predict- 
able from either Hypothesis A or Hy- 
pothesis B. 

2. There is a statistically significant 
tendency for Rorschach responses 
which have two or three scoring cate- 
gories in common to be more highly 
correlated than pairs of responses which 
have but one or no common scoring cate- 
gories. Thus Hypothesis C is verified. 
Nevertheless, the tendency for the cor- 
relations between responses to vary di- 
rectly with the number of common 


scoring categories is so negligible as to 
be associated with a large number of 
gross exceptions. 

3. In general, the number and size 
of the exceptional correlations is such 
as to challenge the value of scoring the 
Rorschach responses on the basis of ab- 
stract categories. 

As a result of these findings, it was 
decided to submit the discrete check 
list responses to a factor analysis (An- 
alysis C) which could provide an ans- 
wer to the following questions: 

1. The intercorrelations among the 
responses could not be satisfactorily 
predicted by certain deductions from 
Assumption I and II: is there some 
structure, some systematic clustering 
effect among the check list responses or 
are their relationships haphazard and 
unpatterned? 

2. If there is a discernible pattern 
of relationships among the check list re- 
sponses, will it be congruent with any 
current practice or belief concerning 
the Rorschach? 

From the factor analysis [14], which 
involved 18 responses and was based 
upon 247 students, the following conclu- 
sions may be offered: 

1. The analysis yielded relatively 
independent factors, most of which re- 
tained their composition when rotated 
obliquely. Nevertheless, an inspec- 
tion of the factors yielded by both ortho- 
gonal and oblique methods of rotation 
does not offer evidence in support of 
some of the common beliefs concerning 
the Rorschach responses, particularly 
those which are reflected in abstract 
scoring practices. 

2. The data suggest that response 
content (with its implied associations 
and projections) may play an impor- 
tant role in determining the functional 
similarities and dissimilarities of cer- 
tain responses, particularly those which 
involve movement. 
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Because of its known practical limi- 
tations, a Rorschach multiple choice 
check list per se is of restricted interest ; 
nevertheless, the form lends itself to 
quantitative analyses which in turn 
yield hypotheses relevant to and readily 
tested by the individual form of the 
test. With perhaps some exceptions it 
may reasonably be supposed that the 
responses which the individual has 
checked on the check list comprise a 
sample of the perceptions which may be 
elicited from him by the ink blots. 
Therefore, in the absence of specific 
contra-indications, it is justifiable to 
generalize the results of certain statis- 
tical analyses (which are convenient 
only with data yielded by the check list 
form of the test) to relevant assump- 
tions which have implications for all 
forms of the test. Consequently, infer- 
ences from the preliminary studies have 
been employed in the formulation of hy- 
potheses which are tested in the present 
study with data yielded by the individu- 
al Rorschach procedure. 


THE PLAN OF THE PRESENT 
INVESTIGATION 


In the present study three different 
analyses are employed for the purpose 
of testing eleven different hypotheses al- 
most all of which were generated pri- 
marily by Assumptions I and II. In or- 
der to facilitate the presentation and 
to clarify the nature of the study each 
of the three analyses will be presented 
separately with a formal statement of 
the hypotheses to be tested, a descrip- 
tion of the subjects employed, a terse 
presentation of the statistical test re- 
sults, and a brief discussion of the ap- 
parent status of the hypotheses. 


ANALYSIS D 


In order to test the consequences of 
Assumptions I and II, it is necessary to 
secure several different measures or 


quantifiable groupings of the scoring 
categories in question. This has been 
accomplished in Analysis D by deter- 
mining for each card the number of re- 
sponses falling in a given scoring cate- 
gory. Thus each card may be considered 
to yield its own evidence of the individ- 
ual’s tendency to give responses which 
belong to a given scoring category. 

A measure of a response tendency 
based on a single card involves certain 
considerations which should be made 
explicit: 


1. Such measures of a response tendency 
are but a fraction of the total protocol score 
for that response tendency. Accordingly, the 
reliability of such a measure cannot be ex- 
pected to approach the reliability of the total 
score for the response tendency (i.e., scoring 
category) in question. 


2. Moreover, such measures of a response 


tendency cannot be expected to be equally re- 
liable from card to card. Therefore, perfect 
evidence for the assumptions of intracategory 
similarity and intercategory difference should 
not be expected. 


8. Although the frequency of responses of 
a given category is known to vary conspicu- 
ously from card to card, this is not expected 
to affect the tests of the internal consistency 
(i.e., the correlation between two variables is 
independent of any constant difference be- 
tween them). 


4. Regardless of the exact manner in 
which responses of a given category are frac- 
tionated the resulting subgroups will differ 
from each other in some qualitative respect. 
These qualitative differences will obviously de- 
tract from the evidence for intracategory simi- 
larity. Some readers may be inclined to seize 
upon such qualitative differences and argue 
that they disqualify a fractional analytic ex- 
amination of Rorschach assumptions. It is to 
be emphasized, however, that such qualitative 
differences are the prime justification for 
studies of internal consistency such as the 
present one; if such qualitative differences 
are so great as to obscure completely the 
trends required by the hypothesis, then the 
trends specified in the hypothesis may be re- 
jected as irrelevant and perhaps the nature 
of the qualitative differences may be consider- 
ed to be the proper subject for analysis. 
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Analysis D is designed to test two hy- 
potheses: 

D. There will be more significant 
interrelations among the number of 
Human Movement responses for cards 
I, II, ITI, VII, IX, and X than there 
will be between the number of Human 
Movement responses for these same 
ecards (I, II, III, VII, IX, and X) 
and the number of Color responses 
(total of FC, CF, and C) for cards II, 
III, VIII, TX, and X. 

E. There will be more significant in- 
terrelationships among the number of 
Color responses (total of FC, CF, and 
C) for cards II, III, VIII, IX, and X than 
there will be between the number of Hu- 
man Movement responses for cards I, 
II, Ill, VII, TX, and X and the num- 
ber of Color responses (FC, CF, and C) 
for cards II, ITI, VIII, IX, and X. 

Hypotheses D and E were tested by 
means of data provided by the following 
three samples: 


Sample I—Comprises a group of 95 Yale 
undergraduates who voluntarily served as 
subjects for a Ph. D. candidate, Mrs. Florence 
Schumer, who administered and scored the 
Rorschach tests in a manner closely conform- 
ing to that of Klopfer [4]. 

Sample II—Comprises 45 Yale undergradu- 
ates who had consulted the writer for guidance 
and therapy. All could be described as moder- 
ately neurotic but none was incapacitated by 
his symptoms nor in apparent danger of enter- 
ing a psychotic episode. The Rorschach test 
protocols employed were prepared by Klopfer’s 
methods. 

Sample II1I—Comprises a group of 100 pa- 
tients who had been treated on either an out- 
patient or an in-patient basis in the clinics 
of the psychiatric service of the New Haven 
Hospital. Almost all of these patients could 
be described as ill, and at least one-third were 
psychotic or had suffered a psychotic episode. 
Most of the examiners were close adherents 
to the Klopfer method although several of 
them were equally familiar with the methods 
of Beck. (The scores employed in the analysis 
were determined in conformance with Klop- 
fer.) 


It is always possible that findings 


based on a particular sample, regard- 
less of its composition, will be consider- 
ed by some readers as inappropriate for 
testing such an instrument as the Ror- 
schach. Basing analyses on several 
groups which are clearly different in the 
quality of their personal adjustment 
affords an important control. 

The data for each sample were of 
such a nature as to make the following 
statistical tests feasible: 


Sample I—55 x? tests were made comprising 
the following groups: 


1. 15 x? tests, based on all possible interre- 
lationships among the number of human move- 
ment responses for cards I, II, III, VII, 
IX and X. 


2. 10 x? tests based on all possible interre- 


lationships among the number of color respon- 
ses for each of the colored cards, II, III, VIII, 
IX, and X. 


3. 30 x? tests based on all possible interre- 
lationships between the number of human 
movement responses for cards I, II, III, 
VII, IX, and X and the number of color respon- 
ses for cards II, III, VIII, IX, and X. 

Sample II-45 x? tests were made compris- 
ing the following groups: 

1. 10 x? tests based on all possible rela- 
tionships between the number of human move- 
ment responses for cards I, III, VII, IX, 
and X. (Because of the small size of sample 
B an analysis of the human movement re- 
sponses for card II was not made.) 

2. 10 x? tests based on all possible interre- 
lationships among the total number of color 
responses for each of the colored cards, II, 
III, VIII, IX, and X. 

3. 25 x? tests based on all possible interre- 
lationships between the number of human 
movement responses for cards I, III, VII, 
IX, and X, and the number of color responses 
for cards II, III, VIII, IX, and X. 

Sample III—55 x? tests were made compris- 
ing groups of x? tests which were arranged 
identically with those provided by sample I. 


The 155 y? tests provided by the an- 
alysis of samples I, II, and III are sum- 
marized in Table 1 below. These data 
have the following implications: 

1. Since almost half (18 out of 40) 
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of the interrelationships among groups 
of human movement responses would 
occur by chance less than 10 per cent of 
the time, Hypothesis D is considered to 


TABLE 1 


A SUMMARY OF THE RESULTS OF CHI-SQUARE 
TESTS REQUIRED BY HYPOTHESES “D” AND 
“E”, SHOWING THE DISTRIBUTION OF 
SIGNIFICANCE LEVELS FOR ALL 
GROUPS COMPARED 
Significance level distri- 
bution of the comparison 
for each of the three pos- 
sible combinations of the 
determinant groups. 


Samp e Mvs.M Mvs.C Cvs.C 
Sample I os eva hey 
1% ‘evel .... 3 1 1 
5% level - 6 5 4 
10% level , . 6 6 6 
99% level 
(All comparisons for Sample I) 15 30 10 
Sample II 
1% level .. 2 0 € 
5% level ...... 3 0 8 
10% level 4 0 - 
99% level 
(All comparisons for Sample II) 10 25 10 
Sample III 
1% level ........ _ 4 1 2 
5% level .. —_ . . 6 1 5 
10% level .............. 8 2 6 
99% level 
{All comparisons for Sample III) 15 30 10 
All Samples Combined 
1% level ian , 9 2 S 
% \evel leal 5 6 17 
10% level . —— 8 20 
99% ievel 
(All comparisons for 
all samples) .................-.- ~ ee 85 30 
Approximate fraction significant 
ob 2005 total: icc 1/2 


1/10 2/3 


be a true hypothesis. That is to say, 
there is a discernable degree of mutual 
consistency among Human Movement 
responses, and as a consequence it is in- 
ferred that the human movement re- 
sponse category is a behaviorally rele- 
vant category in the sense that it refers 
to demonstrably similar ways of react- 
ing to ink-blot stimuli. Since human 
movement responses comprise function- 


ally similar behavioral features, quan- 
tification of them is an appropriate pro- 
cedure. The consistency among groups 
of human movement responses (as well 
as their relative independence from 
groups of color responses) may be taken 
as evidence that the total human move- 
ment response score could bear a valid 
relationship to an important feature of 
the personality which could not be pre- 
dicted from a knowledge of the indi- 
vidual’s color responses. 

2. The similarity among small 
groups of human movement responses 
is not of a high order, and it is not in- 
variably consistent. Since exceptions to 
the hypothesis exist, the common clini- 
cal practice of ascribing a particular 
meaning (or a particular personality 
implication) to small differences in the 
number of human movement responses 
is obviously hazardous and probably un- 
justified. That is to say, small groups of 
human movement responses do not in- 
variably have the same meaning or the 
same behavioral implications; it is 
gratuitous to ascribe any particular 
difference between two individuals as a 
consequence of observed small differen- 
ces (one or two responses) between 
them with respect to the number of hu- 
man movement responses they produce. 

3. Hypothesis E is also a true hy- 
potheses. Two-thirds of the interrela- 
tionships among groups of color re- 
sponses are so marked that they would 
occur less than ten per cent of the time 
by chance (i.e., significant at the 10 per 
cent level). Since less than one-tenth of 
interrelationships between groups of 
human movement responses and groups 
of color responses are significant at as 
high a level, the practice of combining 
the number of color responses into a 
total score which is interpreted differ- 
ently from the human movement total 
score appears to be justified. Moreover, 
since the color scores are related with 
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each other, it is quite possible that the 
total color response scores could bear an 
important degree of relationship with 
some other response score, e.g., a Meas- 
ure of some practically important feat- 
ure of personality. It is evident from 
the data that small groups of responses 
to the color cards may not always have 
the same meaning. It is interesting to 
note, however, that the consistency 
with which a particular meaning may 
be ascribed to responses to the different 
color cards appears to be substantially 
greater than the consistency of mean- 
ing which may be ascribed to the human 
movement responses elicited by differ- 
ent cards. 

4. The status of Hypotheses D and 
E does not appear to be dependent upon 
the exact nature of the sample employed 
inasmuch as the findings for all three 
samples appear to have the same impli- 
cations for the two hypotheses. 

5. There is no evidence that the 
pattern of significant y* tests is consis- 
tent from sample to sample. According- 
ly, it may not be concluded that there is 
a greater similarity among the human 
responses (or among the color re- 
sponses) for any particular group of 
cards than there is for any other group 
of cards. This lack of consistency from 
sample to sample is in keeping with the 
interpretation that the number of insig- 
nificant 7? tests is an expression of a 
generally low level of intercard relation- 
ships among color or among human 
movement determinant scores. 


ANALYSIS E 


In Analysis D hypotheses generated 
by the assumptions of intracategory 
similarity and intercategory difference 
among abstract Rorschach scoring cate- 
gories were examined for two determin- 
ants, human movement and color. The 
hypotheses, D and E, required a demon- 
strable degree of similarity among 


groups of responses which had a com- 
mon determinant but which were dif- 
ferent with respect to the card which 
elicited them. For Analysis D the con- 
sequences of the assumption of similari- 
ty among responses with a common de- 
terminant were tested by means of an 
experimental design wherein differen- 
ces due to the location of the responses 
were distributed among the groups in 
an uncontrolled manner. Such differen- 
ces obviously reduce the sensitivity of 
the analysis, but they probably do not 
result in important systematic differ- 
ences between the groups which were 
being tested. Since the response groups 
employed in Analysis D were deter- 
mined by the cards, differences due to 
the card (e.g., content differences re- 
sulting from the nature of the stimulus 
material) vary systematically from 
group to group and to some degree de- 
tract from the apparent validity of the 
hypotheses. 

Analysis E is designed somewhat dif- 
ferently. Like Analysis D, E is con- 
cerned with testing hypotheses which 
state the consequences of Assumptions 
I and II with respect to the human 
movement and color determinants. In 
Anaylsis E, however, intercategory dif- 
ferences due to content (due to card) 
are uncontrolled, and may randomly re- 
duce the sensitivity of the tests of rela- 
tionship whereas the groups differ sys- 
tematically with respect to location. Ac- 
cordingly, differences due to the location 
factor systematically reduce the demon- 
strable magnitude of the relationship be- 
tween the groups. In Analysis E three 
location groupings are employed: (1) 
The W group comprises all of the hu- 
man movement or all of the color re- 
sponses in the protocol which are scored 
as whole responses. (2) The D group 
comprises all the movement or color re- 
sponses of the protocol which are scored 
as based upon one of the large details of 
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the card. (3) The X group comprises all 
other movement or color responses 
which were not scored as whole respon- 
ses or as large detail responses; for the 
most part the X group comprises re- 
sponses based upon small or rarely used 
portions of the card. Since fewer groups 
are employed in Analysis E than in An- 
alysis D, in Analysis E a larger number 
of responses is available for each group. 
As a consequence, it is possible for the 
color responses to be subdivided so that 
the provisions of Assumptions I and II 
may be examined as they apply to the 
degree to which color responses are 
controlled by form. Analysis E makes 
use of the data provided by samples I 
and III described in Analysis D. The 
data from these two samples were em- 
ployed independently in testing the fol- 
lowing hypotheses. 


Hypothesis F—Groups of human movement 
responses which are different from each other 
with respect to their location (W, D, or X) are 
more consistently correlated with each other 
than they are with groups of color responses 
(FC and CF) which are different from the 
groups of human movement responses not only 
with respect to determinant but also are dif- 
ferent from the Human Movement responses 
with respect to location. 

Hypothesis G—Groups of color responses 
(FC andCF) which are different from each 
other with respect to their location (W, D, or 
X) are more consistently correlated with each 
other than they are with groups of human 
movement responses which are different from 
the groups of color responses not only with 
respect to determinant but also are different 
from the color responses with respect to loca- 
tion. 

Hypothesis H—Groups of FC responses 
which are different from each other with re- 
spect to location are more consistently corre- 
lated with each other than they are with 
groups of CF responses which are different 


TABLE 2 
THE CONFIDENCE LEVELS (BASED ON THE CHI-SQUARE TEST) AT WHICH THE 
STATISTICAL HYPOTHESIS OF “No RELATIONSHIP” MAY BE REFUTED 


FOR VARIOUS PAIRS OF RESPONSE GROUPING 




















“Deter- Loca- Sam- M FC a __CF — 
minant tion ple D Ww x D Ww x D w ane x 
M D I 
Ill 
Ww I 1% 
Ill 5% 
x I 1% _ 
III 10% 5% 
FC D I (5%)* — oe 
Ill (—) — 10% 
WwW 1~— (— — (5%) 
ii — (—) 5% a 
xX I 10% — (5%) 10% _ 
it — — (1%) —_ 5% 
CF OD I (5%) —_ — (—) — 10% 
Im (—) — 10% (5%) 10% 5% 
Ww I — (10%) — — (1%) _— 10% 
zm —- (—) — - —& - — 
x I—- —- & — — (10%) - -—- 
Ill —_ — (5%) —_ 5% (1%) 5% — 





*Some of the confidence levels are enclosed in parentheses. 


The comparisons to which they refer are between 


groups with the same location. They are employed in Analysis F and not in Analysis E. 
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from the FC responses with respect to location 
as well as with respect to the degree to which 
the response is controlled by form (FC and CF 
are here employed to represent the responses 
which they commonly designate in the Klopfer 
scoring system). 

Hypothesis I—Groups of CF’ responses which 
are different from each other with respect to 
location are more consistently correlated with 
each other than they are with groups of FC 
responses which are different from the CF re- 
sponses with respect to location as well as with 
respect to the degree to which the response is 
controlled by form (CF and FC are here em- 
ployed to represent the responses which they 
commonly designate in the Klopfer scoring 
system.) 


The y? tests required by hypotheses F, 
G, H, and I are summarized in Table 2. 
In the instance where the relationship 
between the groups of responses is so 
small as to occur more often than ten 
percent of the time by chance the confi- 
dence level is omitted from the table; 
these cases are indicated by a dash. 
Since the data for samples I and III 
were analyzed independently, the re- 
sults for each sample are shown. The 
significance of the relationship between 
any two particular groups may be readi- 
ly found in the Table by locating the 
row for one of the groups in question 
and the column for the other group; the 
point at which the respective row and 
column intersect gives the significance 
of the relationship between the two 
groups. 

Confidence levels in Table 2 which are 
relevant to Hypothesis F are summar- 
ized in Table 3. Since five of the six pos- 
sible interrelationships among the 
groups of human movement responses 
(three comparisons for each of the two 
samples involved) are significant at the 
ten per cent confidence level and since 
only four of the twenty-four possible in- 
terrelationships between human move- 
ment and color response groups are 
equally significant, hypothesis F is con- 
sidered to be a true hypothesis. The evi- 


dence for hypothesis F is noticeably 
more consistent than the evidence in 
favor of the analogous hypothesis, D. 
Some of this difference may be due to 
the greater reliability inherent in the 
larger groups employed in hypothesis F. 


TABLE 3 
A SUMMARY OF THE RESULTs OF THE CHI- 
SQUARE TESTS REQUIRED BY HYPOTHESIS 
“fF”, SHOWING THE DISTRIBUTION 
OF SIGNIFICANCE LEVELS FOR 
THE GROUPS COMPARED 
Mvs.M Mvys.C 


Samples I and III 


Rae ME bcd 2 0 

a 4 1 
I: I 5 4 
Sao WO ee 6 24 
(All location 


groups combined) 


Approximate fraction 
significant at 10% level 5/6 


1/6 


It seems more probable, however, that 
the difference is a result of the difference 
between the designs employed in Analy- 
ses D and E. The support provided hy- 
pothesis F favors the practice of using 
the total number of human movement re- 
sponses as a quantification for a particu- 
lar response mode. The total number of 
human movement responses appears to 
be an internally consistent feature of be- 
havior in the Rorschach situation and 
accordingly could possess an important 
degree of validity for some personality 
criterion. 

The confidence levels relevant to the 
status of hypothesis G are similarly 
summarized in Table 4. It is apparent 
that significant relationships between 
two groups of responses which involve 
color are twice as prevalent as they are 
between two groups of responses which 
do not have the same determinant. It is 
interesting to note that despite the fact 
that the groups employed in Hypothesis 
G are presumably more reliable than 
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TABLE 4 
A SUMMARY OF THE RESULTS OF THE CHI- 
SQUARE TESTS REQUIRED BY HYPOTHESIS 
“G”, SHOWING THE DISTRIBUTION OF 
SIGNIFICANCE LEVELS FOR THE 
GROUPS COMPARED 


~ Cvs.C Mvs.C 








Samples I and III 


PR IE sesinasiteianthancetece 0 0 
ee NIE a aiiaksedsicintdlacys 5 1 
Be DONE epacccecstttnctiilecns 9 4 
ID BNI nn csinichienchishcicbehaaile 24 24 
(All location 

groups combined) 

Approximate fraction 

significant at 10% level 1/3 1/6 


those employed in Hypothesis E, the 
evidence for Hypothesis G is not as con- 
spicuous as the evidence for the analog- 
ous Hypothesis E. The difference, prob- 
ably a feature of the design of the anal- 
yses, will be discussed in a succeeding 
section. The evidence for Hypothesis G 
provided by the present analysis sup- 
ports the practice of combining the 
color responses into a total score and 
suggests that the tendency to respond 
to color in Rorschach situations repre- 
sents a consistent human trait or be- 
havior attribute which is different from 


TABLE 5 
A SUMMARY. OF THE RESULTS OF CHI-SQUARE 
TESTS REQUIRED BY. HYPOTHESIS “H”’, 
SHOWING THE DISTRIBUTION OF 
SIGNIFICANCE LEVELS FOR THE 
GrRouPs COMPARED 
FC vs.FC FCvs. CF 


Samples I and Il I 


CR 0 0 
eee 2 2 
BE UE, sietisteatinrrceis 3 4 
99% level 

(All location .............. 6 12 
groups combined) 

Approximate fraction 

significant at 

gE 1/2 


1/3 





the tendency to offer human movement 
responses. 

The summarized materia] in Table 5 
suggests that Hypothesis H could be a 
true hypothesis but the distinction is 
not clear; there is no evidence among 
the data provided by Table 2 to support 
Hypothesis I. Nevertheless, these data 
are not considered as a challenge to the 
practice of distinguishing between the 
CF and the FC score. 

The rather modest evidence in Anal- 
ysis E for consistency among the color 
responses is in contrast with the fact 
that in Analysis D two-thirds of the in- 
terrelationships among the color re- 
sponses were found to be significant. 
This contrast is interpreted as a conse- 
quence of the difference between the 
two experimental designs and will re- 
ceive a more complete discussion in a 
subsequent section. 


ANALYSIS F 


Analysis F like Analysis E employs 
samples I and III which were described 
and employed in Analysis D. In other 
respects, however, Analysis F is greatly 
different from Analyses D and E. Anal- 
yses D and E were concerned with hy- 
potheses which specified consequences 
of Assumptions I and IT for the Ror- 
schach scoring distinction between re- 
sponses involving human movement and 
those involving color. Analysis F is con- 
cerned with hypotheses which have to do 
with distinctions in Rorschach scoring 
which are based upon the portion of 
the card presumably eliciting the re- 
sponse. In Analysis E the portions of 
the card eliciting the response (com- 
monly referred to in scoring as the loca- 
tion factor) were described with respect 
to three subdivisions. These subdivi- 
sions are employed in the present analy- 
sis also and comprise the following 
groups: 


1. The number of responses based on the 
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whole card, W. 

(a) W responses with the M determinant 

(b) W responses with the FC determin- 
ant. 

(c) W responses with the CF determin- 
ant. 

II. The number of responses based on the 

large details of the card, D. 

(a) D responses with the M determinant 
(b) D responses with the FC determin- 
ant. 

(c) D responses with the CF determin- 
ant. 

III. The number of responses which have a 
location score other than W or D; in the 
present study the location of these re- 
sponses is designated by the letter X 
(a) X responses with the M determinant 
(b) X responses with the FC determin- 
ant 
(c) X responses with the CF determin- 
ant. 

In the case of Hypothesis K differen- 
ces due to card and to content are un- 
controlled, but differences due to the de- 
terminants vary systematically from 
group to group and systematically de- 
tract from the apparent magnitude of 
the relationship between the groups. 


Hypothesis K — Response groups 
which belong to the same scoring cate- 
gory with respect to location (but are 
different with respect to determinant) 
are more consistently related among 
themselves than they are with response 
groups which belong to a different loca- 
tion category (and are different with 
respect to determinant). 

Confidence levels for the relationships 
relevant to Hypothesis K may be found 
in Table 2 and for the convenience of 
the reader are summarized in Table 6. 
On the basis of the present data, Hypo- 
thesis K is considered to be a true hy- 
pothesis. Nevertheless, only one-half of 
the interrelationships among groups of 
responses which have the same location 
but a different determinant are signifi- 
cant at the ten per cent level. The evi- 
dence of functional similarity among 
groups of responses which have the 


same location is of academic interest 
and is in keeping with the practice of 
counting and interpreting separately 
those responses which are elicited by 
different portions of the card. Rorschach 
examiners commonly ascribe a person- 
ality difference between individuals as 
a result of small observed differences 
with respect to the number of whole or 
large detail responses; the data and the 
analyses of this study may not be taken 
as a justification for this practice. As a 
matter of fact they may better be taken 
as cause for viewing such practice with 
suspicion. 


TABLE 6 


LEVELS OF SIGNIFICANCE OF RELATIONSHIP 
DISTRIBUTED FOR RESPONSE GROUPS WHICH 
HAVE THE SAME LOCATION AND DISTRIB- 
UTED FOR RESPONSE GROUPS WHICH 
HAVE A DIFFERENT LOCATION 


Significance of 
relationships 
between groups 


Significance of 
relationships 


between groups having a 

having the same different 

location location 
1% level .............. 1 0 
5% level .............. 5 1 
ee eee 6 4 
99% level .............. 12 24 

(All compari- 
sons ) 

Approximate ........ 1/2 1/6 


fraction signifi- 
cant at 10% level 





The FC and CF categories although 
scored differently were not shown in 
Analysis E to be conspicuously or con- 
sistently different from each other. In 
Rorschach theory they are considered 
to be expressions of the same general 
class of response and are commonly 
combined to yield a total color response 
score. In keeping with the conception of 
the FC and CF as merely gradations 
within the response to color category 
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they have been combined in a prelimin- 
ary analysis [8] as well as in Analysis 
D of the present series. Viewing the FC 
and CF responses as having a determin- 
ant in common results in the statement 
of Hypothesis L which like the forego- 
ing hypotheses is generated primarily 
from Assumptions I and II. For the 
purpose of testing Hypothesis L groups 
of responses which have FC as their 
determinant are considered to have the 
same determinant as groups of re- 
sponses for which the determinant is 
actually CF. Thus it is possible to in- 
terpret certain of the parenthetical val- 
ues in Table 2 as confidence levels for 
relationships between response groups 
which are the same with respect to both 
determinant and location features. 
Hypothesis L—Responses which have 
both a common location and a common 
determinant category ave more consis- 
tently related with each other than are 
responses which have either a location 
or a determinant factor in common. 
Hypothesis L has an interesting rele- 
vance to Assumptions I and II because 
it states that similarities among re- 
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sponses which are due either to common 
location or determinant categories are 
cumulative, and in this respect it is 
similar in its implications to Hypothesis 
C which was tested in an earlier study 
and is stated in the introduction to the 
present paper. 

The significance levels relevant to 
Hypothesis L are distributed in Table 
7. The significance levels distributed in 
the first row of Table 7 are based upon 
relationships between response groups 
which are identical with respect to lo- 
cation and are similar with respect to 
determinant, i.e., the groups compared 
all have color as a determinant but the 
groups compared are different with re- 
spect to the degree to which color is con- 
trolled by form. The second row in 
Table 7 comprises a distribution of sig- 
nificance levels determined between 
groups of responses which are identical 
with respect to location only. The third 
row comprises a distribution of signifi- 
cance levels between groups of re- 
sponses which are different from each 
other with respect to location and are 
identical with respect to determinant 


TABLE 7 


DISTRIBUTION OF SIGNIFICANCE LEVELS 

















Relationships between groups of responses 
which have a common location and a 
quasi-common determinant 


Relationships between groups of responses 
which have a location only in common .... 


Relationships between groups of responses 
which have a common determinant, either 
quasi or strictly defined 


Relationships between groups of responses 
which have neither a location nor a de- 
terminant category in common 


ph ag ~ Approximate 
fraction 
99% level significant 

1% 5% 10% (All com- at 10% 
level level level parisons) level 
2 3 4 6 2/3 
1 5 6 12 1/2 
2 9 13 30 1/2 
0 1 4 24 1/6 
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(groups which are strictly identical 
with respect to determinant as well as 
those which have a quasi-common de- 
terminant are both included). The last 
row in Table 7 is a distribution of sig- 
nificance levels for the relationships be- 
tween groups of responses which have 
neither a location nor a determinant 
category in common. It may be seen 
from an examination of Table 7 that the 
distributions of levels of significance 
are arranged in a manner in keeping 
with the provisions of Hypothesis L. 


ANALYSIS G 


Analysis G employs data provided by 
samples I and III. The Hypotheses test- 
ed in Analysis D are homogeneous with 
respect to design and implication as 
were those tested in Analyses E and F. 
In the present analysis the hypotheses 
tested, M and N, have their origins in 
preceding studies and in Rapaport [8] 
and Rorschach [9]. 

The Rorschach literature does not 
state explicitly whether location factors 
or determinant factors are more import- 
ant in the abstract scoring of Rorschach 
responses nor is there any evidence in 
the literature which could be taken as a 
definite indication that determinant fac- 
tors are more (or less) consistent in in- 
fluencing the psychological significance 
of the response than are the location 


factors. In the factor analysis of dis- 
crete responses to the Rorschach check 
list [18] no evidence was produced to 
indicate that determinant factors play- 
ed a more important role in influencing 
the interrelationships among the re- 
sponses than did the location factors. 
The relevance of this question to the 
kind of data employed in the present 
analysis is stated in Hypothesis M. 

Hypothesis M—The portion of signi- 
ficant relationships among groups of 
responses which have a common deter- 
minant but differ with respect to loca- 
tion is as great as the portion of signi- 
ficant relations between groups of re- 
sponses which have the same location 
but are different with respect to deter- 
minant. 

Table 8 provides a summary of the 
significance levels which are relevant 
to Hypothesis M. It is apparent that the 
data available for the present analysis 
do not challenge the status of the hy- 
pothesis. In general it appears that the 
consistency among groups of responses 
which have a common determinant is of 
about the same order as that among 
groups of responses which have a com- 
mon location. It should be emphasized, 
however, that the number and diversity 
of comparisons involved in the present 
analysis is not sufficient to confer any 
general validity to Hypothesis M; it can 


TABLE 8 





DISTRIBUTION OF S 





Relationships between groups of responses 
which have a common location (D, W, 
or X) 


Relationships between groups of responses 
which have a common determinant, M, 
FC, or CF) 





IGNIFICANCE LEVELS 
- Approximate 
fraction 
99% level significant 
% 5% 10% (All com- at 10% 
level level level parisons) level 
1 5 6 12 1/2 
2 7 10 18 1/2 
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only be stated that Hypothesis M is not 
challenged by the available data. 

It is a common belief among workers 
who have had intensive experience with 
the Rorschach that the personality sig- 
nificance of the human movement re- 
sponse varies somewhat with the exact 
nature of the human movement which 
is perceived. It is also commonly observ- 
ed among Rorschach workers that the 
cards differ with respect to the kinds of 
human movement responses they elicit. 
[5, 6]. These common informal be- 
liefs based on the clinical experience of 
Rorschach workers are in good agree- 
ment with the results of the factor an- 
alysis of discrete responses [14]. If 
these beliefs growing out of clinical 
practice as well as the implications of 
the factor analysis are valid, it would 
be predicted that: 

Hypothesis N—The interrelationships 
among groups of human movement re- 
sponses which are based on different 
cards would be less marked and less 
consistent than interrelationships 
among groups of human movement re- 
sponses which are not based on differ- 
ent cards and which do not maximize 
this source of differences in content. 

In the case of the large detail re- 
sponses and the whole responses, one 
would not often expect the nature of 
the perceived human movement to be 
contingent upon the subject’s willing- 
ness to use the whole card in preference 
to merely a large portion of it in form- 
ing his response. In general it seems 
plausible to suppose that the location 
scoring designation of a response has 
less to do with its content than the card 
which elicited the response. This seems 
particularly plausible inasmuch as the 
exact location designation of a human 
movement response seems to be more 
often determined by combinatory or 
relatively incidental features of the re- 
sponse than by the exact nature of the 


human movement feature of the re- 
sponse. The foregoing considerations 
are of interest because they predict the 


_ shift in the prevalence of significant re- 


lationships between human movement 
response groups observed upon compar- 
ison of Table 1 (Analysis D) with Table 
2 (Analysis E). Hypothesis N is con- 
sidered to be a true hypothesis and its 
status and implications are further dis- 
cussed in the following section. 


DISCUSSION 


The nature of the procedure employ- 
ed in testing the hypotheses requires 
comment. It is to be noted that all of the 
hypotheses require a comparison of two 
samples of interrelationships. The in- 
terrelationships comprising each sample 
were based upon groups of responses 
which were not independent of each 
other; they instead were related to each 
other to an unknown but varying degree. 
Estimation of the sampling distribu- 
tions of the 7’ statistic for such samples 
of interrelationships would be incon- 
venient, if not prohibitively difficult. Ac- 
cordingly, the chance frequency of any 
particular difference between the sam- 
ple distributions of the 7’ statistics is 
unknown, and it is not possible to speci- 
fy the confidence level with which the 
nu!l statement of the hypotheses may 
be refuted. In the case of each of the 
hypotheses, it is possible to state only 
whether the difference between the dis- 
tributions of the 7’ statistic for the two 
samples of relationships is in a direc- 
tion predictable by the hypothesis. Re- 
gardless of the subjective confidence 
which the reader may have in the status 
of any of the hypotheses, it should be 
noted that the evidence is favorable to 
all the hypotheses except possibly those 
involving the distinction between the FC 
and CF responses. Accordingly, the ac- 
ceptance of Assumptions I and IT as true 
propositions (within the requirements 
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of the stated hypotheses and the char- 
acteristics of the Rorschach samples em- 
ployed) should not be regarded ag reck- 
less or incautious.' 

In evaluating the present analyses 
and their implications for Rorschach 
practices, it should be noted that despite 
the relatively large samples employed, 
a large fraction of the relationships re- 
quired by the hypotheses are insignifi- 
cant. Since there is no apparent pattern 
which leads to a distinction between the 
significant and insignificant y* tests for 
a given sample of relationships, the re- 
lationships exceptional to the require- 
ments of the hypotheses are considered 
to be a result of either the unreliability 
of the response groups or of a modest 
degree of intrinsic relationship among 
the responses which have a common ab- 
stract scoring category. In any event, 
the present data are in no sense a justi- 
fication for the common practice of as- 
cribing important personality differen- 
ces between individuals as a result of 
small differences in the frequency with 
which color responses, movement re- 
sponses, whole responses, or large de- 
tailed responses appear in the Rorschach 
protocols of the individuals. How large 
such differences must be before they 
may be justifiably used in the evalua- 
tion of individuals, if they may ever be 
so used, cannot be precisely inferred 
from the present analyses. Obviously, 
important differences between people 
cannot be predicted on the bases of one 
or two abstract response scores. (It is 
conceivable, however, that the content 
of a single response or the conditions 
under which it is elicited, may have an 
important validity.) Thus with respect 
to the first question which prompted 
this series of studies, it may be stated 

1The Assumptions do not require that the 
Rorschach scoring categories are optimal] for 
classifying responses and the present study 


is not designed to indicate the nature of the 
optimal or most economical scoring categories. 


that some important provisions of As- 
sumptions I and II afford a partial pre- 
diction of the pattern of interrelation- 
ships among the Rorschach responses. 
This may be taken as an indication fav- 
orable to some of the abstract scoring 
practices, but the data must also be tak- 
en as distinctly unfavorable to certain 
common clinical practices involving 
these abstract response scores. 

The results of the analyses are par- 
ticularly relevant to the second general 
question instigating these studies. The 
manner in which responses having a 
common abstract scoring category tend 
to cluster together, and tend to distin- 
guish themselves from responses having 
other types of abstract scoring features, 
suggests that the modes of perceptual 
response to which some of the abstract 
scoring features refer may be members 
of a fairly broad and stable class of per- 
ceptual response modes, and may actu- 
ally be evidences of practically signifi- 
cant classes of human attributes (rela- 
tively stable response patterns). Such 
response patterns, like most response 
patterns, would be a reflection of certain 
important features of the conditions of 
the individual’s existence. If the total 
constellation of such response patterns 
were known, abstract classes of percep- 
tual responses could possibly be of value 
in inferring some of the important con- 
ditions of the individual’s prior existence 
and of perhaps greater value in predict- 
ing the conditions under which certain 
types of behavior could be elicited in the 
future. 

Evidence for the assumptions of intra- 
category similarity and intercategory 
difference among responses with a com- 
mon scoring designation is not of aca- 
demic interest only. The evidence for 
the assumptions not only hints at the 
existence of unexplored perceptual re- 
sponse attributes but more specifically 
is an indication that the total score for 
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some of the response categories could 
be a valid means of predicting a per- 
sonality characteristic. As a matter of 
fact the present series of studies is in 
certain respects a validation of the 
Rorschach test. The present studies 
have sought evidence of the validity of 
the Rorschach by means of tests of in- 
ternal consistency. In situations where 
no dependable, quantified criteria are 
available for validating a test, the possi- 
bility of a test’s being valid may be ex- 
plored by examining its internal consis- 
tency. If the numerous component feat- 
ures of a test are found to be unrelated 
with each other, the total score of the 
test cannot be validly related to any 
simple criterion. 

In a preceding paragraph, it was sug- 
gested that the tendency to perceive hu- 
man movement in response to the Ror- 
schach cards could comprise a portion 
of a broad sample of response patterns 
which were not restricted to the Ror- 
schach situation. If the human move- 
ment response is so conceived, the na- 
ture of the general class of responses 
under which it may be subsumed be- 
comes of interest. Speculation concern- 
ing such a class of responses may be 
guided somewhat by consideration of 
the conditions which determine or qual- 
ify the human movement response. In 
clinical practice it is commonly observ- 
ed that the presence or absence of hu- 
man movement responses having a par- 
ticular content is determined by fanta- 
sies, conflicts or repressions of the in- 
dividual [7]. As a matter of fact, the 
relationship between the content of the 
human movement perceived and the 
content of the individual’s fantasies is 
considered by many clinicians to be 
conspicuous. In the factor analysis of 
discrete Rorschach responses there was 
some evidence that the interrelation- 
ships among responses, including those 
involving human movement, were de- 


termined in part by content. In the 
present paper, there is an important 
difference between Tables 1 and 2 with 
respect to the prevalence of significant 
relationships among groups of human 
movement responses. Only half of the 
interrelationships among human move- 
ment response groups which differed 
from each other with respect to card 
were significant at the ten per cent 
level whereas all but one of the interre- 
lationships among human movement re- 
sponse groups which differed from each 
other with respect to location were sig- 
nificant at the ten per cent level of con- 
fidence. This shift may be interpreted 
as an expression of the importance of 
content in determining the human move- 
ment response. This interpretation 
emerges from these considerations: By 
virtue of their form the cards differ im- 
portantly among themselves with re- 
spect to the kinds of human movement 
responses readily elicited ; that is to say, 
the human movement content which the 
form of the card favors appears to de- 
termine the frequency with which cer- 
tain individuals perceive human move- 
ment in the respective card; such dif- 
ferences due to card content are obscur- 
ed, however, in interrelationships 
among response groups which differ 
systematically with respect to location, 
but do not differ systematically with re- 
spect to card (content). 

Thus it appears that individual dif- 
ferences in the readiness with which a 
human movement is perceived is a func- 
tion of the nature of the stimulus mater- 
ial. Inasmuch as there is a discernible 
correspondence between the objective 
form of the card and the human move- 
ment responses elicited, it is suggested 
that people differ in the readiness with 
which they perceive different kinds of 
human behavior. 

The tendency of the individual to see 
or not to see certain kinds of human 
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acts or attitudes in the Rorschach cards 
may be an instance of his readiness to 
see or not to see evidence for these hu- 
man acts or attitudes in other situa- 
tions. If this general pattern of specu- 
lation is correct, and it appears to be 
congruent with Rorschach’s interpreta- 
tion of the human movement response 
[9], the following assumptions may be 
regarded as tentative indications of re- 
lationships between the Rorschach hu- 
man movement perceptual response ten- 
dency and perceptual tendencies char- 
acteristic of the individual in other 
situations requiring responses involv- 
ing human acts or attitudes: 

III. Any predominant content 
among the Human Movement responses 
elicited by the Rorschach cards should 
be demonstrably related to the content 
of human behavior perceptions elicited 
by situations wherein varied alterna- 
tive perceptions are possible. 

IV. A person who produces a rel- 
atively large number of Human Move- 
ment responses on the Rorschach will 
tend in other situations (wherein var- 
ied alternative perceptions are possible) 
to produce a relatively high number of 
responses involving human acts, atti- 
tudes or attributes. 

These assumptions are not offered as 
clinical aids; as a matter of fact, much 
clinical practice presupposes their val- 
idity. Their value lies in the possibility 
that upon definition of terms they may 
be interpreted in the form of hypotheses 
which specify experimental procedures. 


A thorough study of the human move- 
ment responses would involve devising 
a wide variety of tests which sample 
separate aspects or phases of the broad 
hypothetical class of responses which 
include, in addition to human move- 
ment responses, other types of respon- 
ses, e.g., the expression of suppressed 
or repressed fantasy material. These 
tests would be included in a battery 


which would also include tests for other 
human attributes which might be con- 
fused with the hypothetical classifica- 
tion of responses. If the hypothetical 
class of responses is properly conceived 
and adequately sampled by tests, a fac- 
tor analysis of the intercorrelations 
among the tests should provide evidence 
relative to the status of the Assumptions 
III and IV. 


A similar design could possibly pro- 
vide an advantageous means for exam- 
ining the nature and implications of re- 
sponses which are based on color. The 
present series of investigations appears 
to offer few hints concerning the nature 
of the color responses. A few tangential 
observations may be made, however. It 
should be noted for example, that color 
responses in Table 1 (Analysis D) are 
more consistently related with each 
other than those given in Table 2 (An- 
alysis E). It appears that the differences 
in content due to the nature of the card 
do not detract from the interrelation- 
ships among the color responses where- 
as differences due to the amount of the 
card involved (i.e., location) do detract 
from the interrelationships among color 
responses. This suggests that the impli- 
cations of color responses may be more 
a function of the size of the area of the 
card involved in the response than the 
nature (content) of the response. It is 
of interest to observe in the factor anal- 
vsis [14] that the FC response appeared 
in the same factor with responses based 
upon large details whereas CF responses 
occurred in factors involving the whole 
card responses. 


It would be in keeping with a portion 
of the meaning generally ascribed to the 
color responses to hypothesize a contin- 
uum which describes the degree to 
which perceptions vary from the ex- 
treme of rigid control and formalization 
(e.g., simple form responses) through 
various levels of control (e.g., FC and 


{NTERNAL CONSISTENCY OF RORSCHACH SCORING 17 


CF) to perceptions which are uncontrol- 
led by and incongruent with formal 
considerations (eg., C). Because of 
their very nature, relatively uncontrol- 
led responses (CF) may be inconsistent 
and less highly related with each other 
than the relatively controlled responses 
(FC and F). The idea of a hypothetical 
continuum of perceptual control ex- 
pressed in the Rorschach cards by the 
degree to which color responses are con- 
trolled by form is important in the Ror- 
schach method and it is of interest to 
note that, by an employment of a very 
tenuous reasoning, correspondence be- 
tween the present findings and this im- 
portant assumption is discernible. For 
example in Table 2, it may be seen that 
the FC responses are more highly re- 
lated with the M response (M respons- 
es are highly dependent on form) than 
are the CF responses. Obviously, the 
present data are inadequate to the 
task of even tentatively defining the 
color response, but it is of interest 
that an interpretation of the present 
findings which is in keeping with the 
control concept of the color respons- 
es can be construed. If Rorschach 
responses based on small or rare details 
are considered to be most controlled and 
whole responses are considered to be 
least controlled, additional evidence for 
this hypothetical continuum can be con- 
strued from some other results; e.g., it 
may be observed in Table 2 that the 
whole responses show the smallest num- 
ber of consistent interrelationships 
whereas responses involving the X loca- 
tion (made up principally of small de- 
tails) shows the largest number of sig- 
nificant relationships. It should be ob- 
served, however, that the slight differ- 
ence in the number of significant rela- 
tionships to which this paragraph re- 
fers may well be due to chance. 
Regardless of the validity of the fore- 
going conjectures, if degree of control 


in perceptual responses is conceived as 
a human attribute, it should be possible 
after definition of the word control to 
formulate a variety of quantifiable in- 
stances of this perceptual attribute (in- 
stances from the Rorschach as well as 
from other situations) and study the 
relative consistency of their interrela- 
tions in the presence of measures of 
other attributes, the nature of which 
might be confused with the hypothetical 
control attribute. Factor analysis offers 
a suitable statistical approach for such 
a study. 

At present neither the meaning nor 
the practical import of the Human 
Movement response or of the color re- 
sponse is objectified. Authoritative 
statements concerning them do not fully 
agree, and such statements comprise 
terms which for the most part are ob- 
secure or circularly defined. This prob- 
ably is largely due to the fact that few 
unambiguous quantitative criteria for 
different aspects of the personality are 
available (quantified criteria for some 
Rorschach scores have been reported 
[2] but as far as the writer is aware 
not described). Since such objective 
criteria for defining the meaning of the 
Rorschach responses are lacking, their 
meaning is not only unspecified but must 
vary from psychologist to psychologist 
and from day to day. (The uncanny 
competence of some clinicians is no 
more relevant to this problem than the 
incompetence of others.) 

This state of affairs is important, 
not only from the standpoint of psychol- 
ogy as a behavioral science or from the 
standpoint of the problems in teaching 
it creates, but (since all of the subjec- 
tive concepts of the implications of hu- 
man movement and of color responses 
cannot be equally valid) it is impor- 
tant from the standpoint of the patient’s 
welfare. 

Research oriented toward the valida- 
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tion of these responses has produced 
promising but unsatisfactory evidence 
of validity. Since Rorschach validation 
research has had the handicap of ques- 
tionable criteria, the following ap- 
proaches to this important problem may 
be suggested: 

1. The systematic development of 
objective, quantified criteria for per- 
sonality characteristics important in the 
validation of the tests. 

2. Anhypothetic-deductive approach 
wherein an explicit unambiguous inter- 
pretation of a response group is given; 
numerous tests generated by this inter- 
pretation are prepared; intercorrela- 
tions of these tests are examined for 
mutual consistency; and the explicit in- 
terpretation rejected as invalid if the 
resultant tests are not mutually consis- 
tent. 

The present discussion will be recog- 
nized as favoring the second of the two 
suggested alternatives. 


SUMMARY AND CONCLUSION 


Three samples comprising a total of 
240 individually administered Ror- 
schach tests were employed in testing a 
series of hypotheses generated by the 
following assumptions: 

I. That all of the responses falling 
in a given category are similar in some 
behavioral respect. ; 

II. That the psychological signifi- 
cance of responses falling in a given 
category is different in some respect 
from responses placed in other categor- 
ies. 
As a result of the application of a va- 
riety of analytical designs the following 
conclusions may be offered. 

1. Within the requirements of the 
stated hypotheses and the characteris- 
tics of the samples employed, Assump- 
tions I and II may be accepted as true 
hypotheses. 

2. Human Movement responses com- 


prise functionally similar behavioral 
elements and quantification of them is 
an appropriate procedure. The consis- 
tency among groups of human move- 
ment responses (as well as their relative 
independence from groups of color re- 
sponses) may be taken as evidence that 
the total Human Movement response 
score could bear a valid relationship to 
an important feature of the personality 
which could not be predicted from a 
knowledge of the individual’s color re- 
sponses. 

3. The practice of combining the 
number of color responses into a total 
score which is interpreted differently 
from the Human Movement total score 
appears to be justified. Moreover, since 
the color scores are related with each 
other, it is quite possible that the total 
color response scores could bear an im- 
portant degree of relationship with 
some other response score, e.g., a meas- 
ure of some practically important fea- 
ture of personality. 

4. The evidence of functional simi- 
larity among groups of responses which 
have the same location is in keeping 
with the practice of counting and inter- 
preting separately those responses 
which are elicited by different portions 
of the card. 

5. The present data are in no sense 
a justification for the common practice 
of ascribing important personality dif- 
ferences between individuals as a result 
of small differences in the frequency 
with which color responses, movement 
responses, whole responses or large de- 
tail responses appear in the Rorschach 
protocols of the individuals. How large 
such differences must be before they 
may be justifiably used in the evaluation 
of individuals, if they may ever be so 
used, cannot be precisely inferred from 
the present analyses. Obviously, impor- 
tant differences between people cannot 
be predicted on the bases of one or two 
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abstract response scores. 


6. Responses which have both a com- 
mon location and a common determinant 
factor are more consistently related 
with each other than are responses 
which have either a location or a deter- 
minant factor in common. 


7. The portion of significant rela- 
tionships among groups of responses 
which have a common determinant but 
differ with respect to location appears 
to be as great as the portion of signifi- 
cant relations between groups of re- 
sponses which have the same location 
but are different with respect to deter- 
minant. 


8. The data offered no strong sup- 
port for the practice of distinguishing 
between the CF and the FC responses. 
The findings are not interpreted as com- 
prising a direct challenge to this prac- 
tice, however. 

9. It appears that individual differ- 
ences in the readiness with which a Hu- 
man Movement is perceived is a func- 
tion of the nature of the stimulus mater- 
ial. 


10. The implications of color re- 
sponses may be more a function of the 
size of the area of the card involved in 
the response than the nature (content) 
of the response. 


11. The whole responses show the 
smallest number of consistent interrela- 
tionships whereas responses involving 
the X location (made up principally of 
small details) shows the largest number 
of significant relationships. 

In the discussion it is suggested that 
an employment of a hypothetic-deduc- 
tive approach for the investigation of 
the validity of the Rorschach and other 


projective tests may at present prove to 
be the most feasible. 


Received March 11, 1949. 
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A METHODOLOGICAL PROBLEM IN BECK’S 
ORGANIZATIONAL CONCEPT 
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RGANIZING activity in Rorschach 

responses has been defined by 
Beck in the following manner: “A re- 
sponse is scored organization, or Z, when 
two or more portions of the figures are 
seen in relation to one another, and 
when the meaning perceived in the com- 
bination, or in any of the component 
portions, obtains only from the fact of 
this organization.” [2, p. 59]. Beck 
points out that although Rorschach did 
not identify the organization process as 
such, it is implicit in his discussion of the 
whole response [2, p. 58]. Furthermore, 
Rorschach concluded that the number of 
whole responses is an indicator of in- 
telligence [4, p. 59], and it has subse- 
quently been widely used as such. Tak- 
ing his cue from Rorschach, Beck pre- 
sented the idea that organization can 
take place at levels of integration other 
than the whole response. As can be seen 
in the above definition, Beck argued that 
organization is involved wherever de- 
tails of the cards are related to one an- 
other, even though the final product is 
not scored as a whole response. He set 
out to assign numerical weights for the 
various types of organization which he 
identified. His system is based on an an- 
alysis of the relative frequencies with 
which these several types of organiza- 
tion occurred in each of the ten cards 
for asample of 39 superior adults. From 
these studies Beck conceived and pre- 
sented his Z system which gives a table 
of the weighted values which should be 
assigned for each of the various types 


of organizational activity that he dis- 
covered [2, p. 208]. 

The process of weighting a response 
for organization involves several steps. 
It is first necessary to determine wheth- 
er a given answer contains any organi- 
zation (done by applying the criteria 
set up by Beck), and then to determine 
which type is present [2, pp. 58-60]. The 
table which furnishes the weighted or- 
ganizational value for that response is 
then consulted and the score for a rec- 
ord as a whole is the summation of these 
weighted individual Z values. The theo- 
retical suppositions on which this sys- 
tem is based appear to be justified in the 
sense that it seems logical that all whole 
responses need not represent the same 
amount of organizing activity and, fur- 
thermore, that organization can occur 
at levels of organization other than the 
whole response. 

For purposes of clarity, let us ex- 
amine the assumptions which underlie 
the development of the organizational 
score. The basic assumption is that a di- 
rect and measurable relationship exists 
between the amount of organization in 
the responses comprising a protocol and 
intelligence; in fact, that organization 
is one technique of indexing facility in 
conceptualizing [3, p. 12]. In the final 
analysis, it is the validity of this assump- 
tion which needs to be established in 
operational terms. The second assump- 
tion involves two parts, both of which 
are concerned with the technique of 
scaling organization. The first part in- 


20 


BECK’S ORGANIZATIONAL CONCEPT 21 


volves the criteria which are invoked to 
discover whether any organization is 
present [2, pp. 58-60]. These criteria— 
nine in number—which were set up by 
Beck on the basis of experience, have 
never been subjected to systematic vali- 
dation. The second part, concerned with 
the belief that the less frequently a kind 
of organization is given the more de- 
manding it is of organizing facility, led 
to the development of Beck’s system for 
weighting responses. The weights are 
assigned as a function of the area of the 
card which is used. In a psychometric 
sense, the weights are established on the 
basis of “difficulty,” rather than on a 
foundation of empirically demonstrated 
power of discrimination between groups 
of known intelligence levels. A kind of 
response which qualifies as involving or- 
ganization by Beck’s criteria may carry 
one weighted value if it occurs in one of 
the cards, or a different weight if it oc- 
curs in another, depending upon the fre- 
quency with which it was given for 
either card by the members of his sam- 
ple. The weighting system, then, reflects 
the commonness with which the differ- 
ent types of organization occur on the 
various Rorschach plates. Those occur- 
ring most frequently are assigned the 
smallest weights and those given least 
frequently are assigned the highest [1]. 

It should be recognized that these two 
groups of assumptions can be mutually 
independent. It may be true that one di- 
rect index of intelligence is organizing 
ability but that Beck’s system of meas- 
uring this ability is invalid, or it may 
be that Beck’s system for measure- 
ment is entirely valid but that or- 
ganizing facility is not an index to in- 
telligence. The other possibilities, of 
course, are that both or neither of the 
two basic assumptions are true. Fur- 
thermore, in the second assumption, the 
first part which involves Beck’s multiple 
criteria for the determination of the 


presence of organization may be valid 
without it necessarily following that his 
complex weighting system must be valid 
also. 

Before any definitive statement can 
be made about the nature of the organi- 
zing function, it will be necessary to test 
each of these assumptions systematical- 
ly against external criteria which are 
operationally defined. 


THE STUDY 


This report is an outgrowth of a larg- 
er systematic study which is now in 
progress and which is designed to in- 
vestigate the meaning of organization 
in Rorschach protocols. In this report we 
will not be concerned with investigating 
Beck’s assumption of a direct relation- 
ship between organizing activity and 
intelligence, although this problem is 
under consideration in the larger study. 
Neither shall we consider, at this time, 
the validity of Beck’s criteria for deter- 
mining the presence or absence of or- 
ganizational activity, although this too 
is a very central problem. We shall be 
concerned now with an analysis of the 
weighting system used by Beck in con- 
nection with the various types of organ- 
ization. Specifically, we wish to test the 
hypothesis that the weighting system 
extends the differentiation of organizing 
facility beyond the differentiation which 
can be had by the application of the 
criteria for presence or absence of or- 
ganizing ability alone. We wish to dis- 
cover the extent of similarity between 
the distribution based on the number of 
organized responses, and that based on 
the total of weighted responses. If the 
relationship is relatively low, — even 
though the operational validity of the 
system is still not established—we could 
conclude that Beck achieved the goal of 
providing a more sensitive differentia- 
tion of organizing facility. On the other 
hand, if the relationship is high the 








22 GLEN P. WILSON, JR. AND ROBERT R. BLAKE 


most reasonable conclusion would be 
that the weighting system does not ex- 
tend the differentiation beyond that al- 
ready available simply by counting the 
number of organized responses. 


TREATMENT OF DATA 


Subjects were drawn from two sourc- 
es. The first group is composed of 60 
subjects, 40 male and 20 female, all 
senior and first year graduate students 
at the University of Texas. The second 
group is made up from the 44 cases re- 
ported in Beck’s Rorschach’s test, Vol. 
II [3]. These represent a sample of 21 
normals, included because they demon- 
strate case materials from a wide intelli- 
gence range, a group of 15 neurotics and 
8 subjects who were classified as 
schizophrenic. Since the results are al- 
most identical for each of these several 
groups, the analyses are presented sep- 
arately for each and in combination for 
the total of 104 subjects. 

In a pilot analysis of the data from 
the larger systematic study, one of the 
measures which was being tested in- 
volved the distribution for number of 
responses within a record which con- 
tained any organization as determined 
by Beck’s criteria—a distribution which 
is derived without regard for the 
weighted values of the responses includ- 
ed in it. This measure is merely the 
simple summation of the responses con- 
taining any Z and it is designated as 
number of Z or tZ. We reasoned that 
number of Z responses and quantity of 
weighted Z might both contribute pre- 
dictive efficiency through multiple cor- 
relations against an external criterion 
of intelligence and so, in order to test 
this assumption, we computed the prod- 
uct-moment correlation between them. 
We expected these intercorrelations to 
be substantial but, in fact, we found 
that #Z bears an extremely high and con- 
sistent relationship to total weighted Z 


scores. A summary of the calculations 
for our cases and for Beck’s data is pre- 
sented in Table 1. 


TABLE 1 


RELATIONSHIP BETWEEN BECK’s TOTAL 
WEIGHTED Z AND TOTAL NUMBER 
OF Z RESPONSES 


Group N r= , SE k 


Male, Normals ............ 40 .988 .004 .154 
Female, Normals ........ 20 .984 .007 .178 
Beck, Normals .............. 21 .993 .003 .118 
Beck, Neurotics ....... 15 .994 .008 .109 
Beck, Schizophrenic .... 8 .990 .007 .141 
Total, all groups .......... 104 .989 .002 .148 

*Product-moment correlations. 3 - -" “i 


An examination of the results in Table 
1 shows that the relationship is ex- 
tremely high with none of the correla- 
tions smaller than .98. The correlations 
are consistent for the several groups 
and, are apparently independent of sex, 
intelligence (since a wide range of in- 
telligence is included in the total group), 
and deviant adjustment. The interesting 
question as to how this result could oc- 
cur is considered below. 

As has already been indicated, Beck’s 
Z table was constructed on the basis of 
the frequencies with which certain types 
of organization occurred in responses 
for the different cards; those more fre- 
quently used responses (i.e., “Bat” to 
Card I) being assigned low values and 
with the ones which are less frequently 
employed being given higher ones—the 
system of assignment being the stand- 
ard table of areas and ordinates of the 
normal curve. In application, the ten- 
dency is for a record which includes a 
number of organized responses to con- 
tain a few of the low Z values because 
of their commonness to records in gen- 
eral and for a few of the higher Z values 
to be found which are different from 
those higher Z values found in other rec- 
ords. Of course, if #Z is low, then the 
chances are good that only low weighted 
Z values will be found, which will low- 


BECK’S ORGANIZATIONAL CONCEPT 


er the mean of the weighted Z val- 
ues (M.) also. One might reasonably 
expect to find a positive relationship be- 
tween M, and ¢Z due to the fact that as 
#Z increases a larger number of Z scores 
of higher values will be included and M. 
will rise as well. But this should be true 
only up to some critical value of #Z at 
which the M, will tend to stabilize be- 
cause of the limited number of low 
weighted Z scores. From a graph of the 
M, against #Z which was constructed 
for this purpose, the critical {Z was ar- 
bitrarily chosen to be 20.5. The corre- 
lations between M, and #Z for the two 
segments with respect to the dichotomy 
are shown in Table 2, which includes all 
data from Beck and all of our own. 


TABLE 2 
RELATIONSHIP BETWEEN MEAN Z (M,) AND 
TOTAL NUMBER OF Z RESPONSES 








SE 





Group N 3° ’ 
2 | eee es 77 .652 .065 
Mk GE <cowchicsinrnidce 27 —.090 
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*Product-moment correlations. 


Table 2 shows that M, increases in a 
fairly consistent manner as $#Z increases 
up to the arbitrary point. Since the 
total Z score can be defined mathematic- 
ally as M, times #Z, the total Z will in- 
crease at an increasing rate for values 
of ¢Z up to 20.5, suggesting that points 
along the Z scale will be relatively far- 
ther apart for corresponding values of 
tZ from 0 to 20.5, and that for values 
above 20.5 the M, will be so stable as to 
become a constant (M of the M. is 3.51, 
o is .259, and o, is .051). In either case, 
the tendency will be for a minimum of 
overlap on the total Z scale for corres- 
ponding points along the #Z scale, mak- 
ing for the high correlation between Z 
and #Z. 

The regression equation for best pre- 
diction of total Z score when #Z is 
known is, Z=3.55 (#Z) — 4.42, with a 
standard error of an estimated Z score 
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TABLE 3 
Best ToTAL WEIGHTED Z PREDICTION WHEN 
TOTAL NUMBER OF Z RESPONSES 
Is KNOWN* 
Best Z Best Z 
2Z Prediction $Z Prediction 

(to nearest .5) (te nearest .5) 
1 nies 26 88.0 
2 2.5 27 91.5 
3 6.0 28 95.0 
4 10.0 29 98.5 
5 13.5 30 102.5 
6 17.0 31 105.5 
7 20.5 32 109.0 
8 24.0 33 112.5 
9 27.5 34 116.5 
10 31.0 35 120.0 
11 34.5 36 123.5 
12 38.0 37 127.0 
13 41.5 88 130.5 
14 45.5 39 134.0 
15 49.0 40 137.5 
16 52.5 41 141.0 
17 56.0 42 144.5 
18 59.5 43 148.0 
19 63.0 44 152.0 
20 66.5 45 155.5 
21 70.0 46 159.0 
22 73.5 47 162.5 
23 77.0 48 166.0 
24 81.0 49 169.5 
25 84.5 50 173.0 








*The standard error of an estimated Z score is 4.74. 


**Regression line does not cross the x axis exactly 
at the origin. 


of 4.74. The best total Z score prediction 
for any value of #Z from 1 to 50 is 
shown in Table 3. 

After completing the analysis re- 
ported in Table 3, additional protocols 
from a sample of 32 males similar to 
those shown in row 1 of Table 1 became 
available, and we used them to test the 
accuracy of the predictions based on the 
data shown in Table 3. Predicting the 
total Z score from the #Z we found that 
78 per cent of the cases fell within 
+ 1SE and that 100 per cent were with- 
in + 2 SE. In view of this consistency 
on a sample independent of those used 
in the study, we feel that the data fur- 
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nished in Table 3 should prove useful to 
those workers who are interested in test- 
ing the point for point correspondence 
between the weighted Z score and the 
tZ scale on their own data. 


DISCUSSION AND CONCLUSIONS 


This paper is concerned with a meth- 
odological problem stemming from 
Beck’s effort to construct a scoring sys- 
tem for weighting organizational activi- 
ty in the Rorschach task. We have not 
been concerned, at this time, with the 
relationship between such activity and 
some external criterion against which 
to validate it nor have we considered 
the validity of Beck’s criteria for estab- 
lishing the presence of organization. 

In this study we tested the hypothesis 
that Beck’s weighted Z system extends 
the differentiation of organizing facility 
beyond that obtainable simply by sum- 
ming the responses which qualify by his 
criteria as possessing organization into 
a score. From an a priori standpoint, 
high correlations between these two 
would indicate an absence of further 
differentiation while low ones would 
suggest that Beck’s weighting system 
introduces variance which is indepen- 
dent of that obtained simply by sum- 
ming the number of organizing acts. In 
order to discover the level of interrela- 
tionship, product-moment correlations 
were computed for a varied group of 104 
subjects. No coefficient was found to be 
smaller than .98. These data are inter- 
preted as showing a consistent and ex- 
tremely strong relationship between 
these two distributions, and lead to the 
rejection of the assumption that the 


weighting system introduces independ- 
ent variance. It appears that deter- 
mination of the types of organized re- 
sponses involved, the weights for each, 
or the sum of their weighted Z values 
contributes little more than can be had 
simply by applying the organizational 
criteria. No advantage is gained in the 
methodological extension which is in- 
volved in the system of weighting differ- 
entially each of the individaul responses 
which involves organization. 

The next logical step should involve 
a systematic validation of each of the 
criteria of organization against some ex- 
ternal measure applied over a wide in- 
telligence range. If these correlations 
were significant, it would then be possi- 
ble to assign appropriate beta weights 
for each kind in such a way as to permit 
the most accurate prediction of intelli- 
gence from organizing activity. If, on 
the other hand, they should prove to be 
unreliable, it would be necessary to re- 
ject or at least to revise the assumption 
that organizational activity in the Ror- 
schach technique can be used as an in- 
dex of intellectual functioning. 


Received May $1, 1949. 
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CONSTIPATION AND ADJUSTMENT 
AMONG ILLITERATE MALES 


WILLIAM D. ALTUS 


SANTA BARBARA COLLEGE 
UNIVERSITY OF CALIFORNIA 


Ce ONSTIPATION, the Universal 
Malady,” was the caption over a 
series of four short articles in a British 
medical journal a few years ago (The 
Medical Press and Circular, 1943). 
Some credence is lent to the universality 
of disorders in this one aspect of elimi- 
nation by the amount of space devoted 
to advertising nostrums for its elimina- 
tion in newspapers and magazines in 
the United States. An air of quasi-re- 
spectability is attained by the manu- 
facturers of one of the nostrums since 
it retains on its payrolls one of the best 
known of the nationally-syndicated 
newspaper columnists, who broadcasts 
weekly the shape of things to come in 
sharp propinquity to the announcer’s 
broodings over the infirmities of the 
sluggish colon which his sponsor offers 
to quicken in nature’s kindly way. 
Hurst, a British physician who has 
written much concerning the operation 
of the digestive tract, has noted [8] the 
effect of such advertising, in Great 
Britain, upon certain of its readers. 


Most of the patients begin to take purga- 
tives on their own initiative because they 
think they are constipated. In many cases this 
is not because of any irregularity in the ac- 
tion of their bowels, but because their symp- 
toms remind them of what they have read in 
advertisements for patent medicines. “Your 
whole system is poisoned and you feel sour, 
sunk and the world looks punk.” By taking 
its purgatives they hope for “inner cleanli- 
ness and buoyant health.” 


It would seem from the quotation 
given that Hurst considers constipation 
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to be psychosomatic, in the sense that 
emotionally toned attitudes obviously 
predispose certain readers of advertise- 
ments to place implicit trust in what 
they read and to find in the symp- 
toms listed cognates of their own mal- 
aise. In another place in the same article, 
Hurst notes that much constipation is 
due to loss of the defecation reflex, ow- 
ing to “laziness, insanitary conditions 
of the water closet or false modesty.” 
In the treatment of such individuals, he 
emphasizes the interactional effect of 
psyche on some by noting 

Most important of all is to make the patient 
realize that his bowels are made for man, not 
man for his bowels and that he would be wise 
to follow the good example of the dog, not the 
bad example of the cat, and never look behind 
him. If he ceases to be bowel-conscious, his 
bowels will look after themselves, and he will 
neither be constipated nor, what is worse, 
imagine that he is constipated. 


This position is in essential agree- 
ment, in certain respects, with that of 
Flanders Dunbar in her 1948 version of 
Psychosomatic Diagnosis [6], where she 
notes that chronic constipation fre- 
quently carries with it “a large emotion- 
al component.” She notes that various 
organic conditions predisposing to con- 
stipation may be present but that “the 
psychic component looms large.” Typical 
of the chronically constipated, she claims 
[6], are distrust, lack of confidence “re- 
garding other people,” and the feeling 
of being rejected and unloved. In para- 
noia and in melancholia these feelings 
are exaggerated, she notes, and it is 
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among these nosological categories that 
constipation has been shown to be par- 
ticularly severe by Alexander and 
French [1]. These latter authors give 
the following verbalization of what 
they feel to be the unconscious emotional 
syllogism implicit in psychogenic con- 
stipation: “I do not receive anything 
from others, and therefore I do not need 
to give; indeed I have to cling to what 
I possess.” Dunbar’s version [6], though 
slightly different in form, adumbrates 
the same psychoanalytic mechanisms: 
“IT cannot expect anything from any- 
body. Therefore, I do not need to give 
anything. I must hold on to what I 
have.” 

Guirdham, in discussing the etiology 
of constipation [7], assumes that many 
of the elimination difficulties of adult 
life stem from two sources, rigid time 
schedules in early bowel training and 
from an associated sense of guilt, de- 
rived from the mother who regards the 
child’s pristine sense of enjoyment in all 
excretory processes as unseemly and in- 
fra-human. In this connection he makes 
the following humorous but possibly sig- 
nificant comment [7]: 

The mother who reproves an infant for 
playing with his penis..... is just as likely 
to regard with disapproval the child’s evident 
enjoyment of its excretory processes out of 
envy, no doubt, for his proficiency in prac- 
tices she herself has long since abandoned. 
Later in the article Guirdham notes 
that adult constipation is frequently 
noted in association with obsessive-com- 
pulsive tendencies. “The driving obses- 
sional temperament,” he says, “often 
does not permit its possessor to spare 
time for the process of defecation.” In 
contrast, anxiety states are often asso- 
ciated with diarrhea, though he enters 
the caveat that the mere presence of 
association between temperament and 
elimination does not necessarily imply 
any etiological connection between them. 


It might appear from the quotations 
noted that all medical researchers in the 
etiology and therapy of constipation 
recognize the importance of early con- 
ditioning, temperament and current em- 
otional factors. Such an _ inference 
would, however, be unwarranted. More 
typical of routine medical opinion, un- 
tainted by psychiatric considerations, is 
a quotation from Streicher, who, in dis- 
cussing [9] the treatment of chronic 
constipation, says that 

This entity entails primarily an intelligent 

understanding of the physiology of the colon 
before treatment is attempted. The physio- 
logic principles which are so well estab- 
lished, yet so well forgotten, are suppression 
of the defecation reflex, the lack of fluid in- 
take, intake of too much or too little residue 
in the diet, undue physical or mental strain, 
lack of adequate exercise, and in general, 
lack of proper understanding and evaluatiun 
of associated conditions. 
It will be noted that the primary factor 
listed by this writer would be subsumed 
under the physiological, although he 
mentions, in passing, “undue physical 
and mental strain.” Also illustrative of 
similar attitudes which condition medi- 
cal research is the report by Dolkart and 
Dentler [5] on the treatment of consti- 
pation. Of 29 subjects treated, five are 
reported to have been relieved of their 
constipation through diet alone; the re- 
maining 24 were subjected to various 
medicaments, of which a psyllium seed 
derivative proved to.be the most effec- 
tive. No follow-up study of these 29 in- 
dividuals is given; consequently, the 
long-time efficacy of such treatment, 
based entirely upon organic factors, 
cannot be evaluated. 

Dunbar, in her discussion previously 
cited [6], admits that dietary measures, 
enemas, massage and the like may suf- 
fice for “practical purposes.” On the 
other hand she insists that a certain 
amount of constipation is due to a deep- 
seated emotional disturbance. In this 
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latter type of constipation it is neces- 
sary, she feels, to uncover the uncon- 
scious conflicts of presumptive etiologi- 
cal significance. “Long-standing consti- 
pation,” she continues [6], “‘is often re- 
lieved by psychotherapy. Where consti- 
pation is only one manifestation of a 
deeper-lying disturbance in the patient’s 
emotional make-up, treatment to be ef- 
fective must be directed toward a reori- 
entation of the total personality.” 


THE PRESENT STUDY 


The writer feels that the data to be 
presented in this section may throw 
some light on the degree of association 
between chronic constipation and cer- 
tain emotional factors which Dunbar 
and others insist upon. During the 
late war, the writer, in one of his Army 
assignments, was in charge of the psy- 
chological testing in a center for the 
training of illiterates. In all, over 15,000 
illiterate soldiers came under the pur- 
view of this training center during the 
26 months of its activation. A sizable 
number of orally administered tests 
were routinely given to each incoming 
soldier. One of the tests was a laborious- 
ly constructed measure of “adjustment,” 
which, through repeated statistical an- 
alyses, was made into an especially ef- 
fective instrument for use with the 
Army illiterate. This test [3] and the 
longer ones from which it was derived 
[2] have previously been shown to pos- 
sess considerable validity for three 
types of criteria: (1) discharge for “in- 
aptness” (Section VIII at that time), i.e., 
inability to meet the requirements for 
graduation from the center, (2) dis- 
charge for psychoneurosis and enuresis, 
(3) the frequenting of “sick call” when 
no organic basis therefor could be found 
by the attending medical officers. The 
entire list of questions composing the 
final, shortened form of this adjustment 
test is presented in Table 1, along with 


the number of maladjusted responses 
made by 100 constipated illiterates and 
100 illiterates who did not fall into the 
constipated category. For purposes of 
research an illiterate was placed in the 
constipated group if he claimed to be 
constipated to such an extent that once 
a week, on the average, he took some 
form of medicament to alleviate his con- 
dition. Those who did not fall into the 
once-a-week category were considered, 
again for research purposes, to be free 
from constipation, though some admit- 
ted to occasional elimination difficulties. 

Since 100 cases are employed in each 
category, the constipated and the non- 
constipated, it is possible to consider 
the raw number of maladjusted answers 
to individual items as percentages also. 
If the figures in the first two columns of 
Table 1 are regarded as percentages, it 
is easy to determine, statistically, 
whether the observed variations in re- 
sponding to the item arise from chance 
factors. Before commenting on these t- 
values, one should note that in every in- 
stance the constipated group gave more 
maladjusted responses than did those 
who were not constipated. The smallest 
difference for any one of the items is for 
the ninth question, “Does it bother you 
to talk to a person that you’ve just 
met?” Thirty of the constipated group 
said it was true of them while only 20 of 
the nonconstipated group said it was 
true for them. The t-value of these ten 
points in percentage difference is 1.67 
and may be considered as not deviating 
significantly from chance expectancy. A 
perusal of the t-value column will show 
that only five items, 1, 2, 9, 11, 13, have 
values lower than 3.00. Two of these 
five, items 2 and 11, are within the .01 
level of confidence; in all, therefore, 
some 33 of the 36 comparisons “wash” 
at the .01 level of confidence or better. 

In general, then, it will be noted that 
those who admit to frequent constipa- 
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TABLE 1 


MALADJUSTED RESPONSES OF 100 CONSTIPATED ILLITERATE SOLDIERS AND OF 
100 ILLITERATE SOLDIERS WHO WERE Not CONSTIPATED 














Maladjusted t-value 








Answers of Diff. Item 

C* NC+ 

42 25 2.43 1. Does it bother you to sleep and eat and wash with so many men? 

25 11 2.80 2. Did your draft board give you a raw deal? 

60 36 3.43 8. Could you do more for your country on your civilian job than 
you can in the Army? 

48 14 5.67 4. Did they give you a good physical examination at the induction 
station? 

54 22 5.33 5. Are you strong and healthy enough to be a soldier? 

a. OF 4.86 6. Does it bother you to stand and wait in a group? 

51 24 3.86 7. Do you feel blue very often? ; 

57 34 3.29 8. Do you feel very tired toward the end of the day? 

30 3=—.20 1.67 9. Does it bother you to talk to a person that you’ve just met? 

46 19 4.50 10. Do you often feel just miserable? 

47 28 2.71 11. Are your feelings easily hurt? 

55 25 4.29 12. Do you have trouble sleeping at night because you lie awake 
thinking about things? 

49 31 2.57 13. Have you had lots of hard luck? 

55 825 4.29 14. Do you feel lonely most of the time? 

26 7 3.80 15. Do you often feel that the whole world is against you? 

35 = 14 4.20 16. Have peopie played mean tricks on you when they had no rea- 
son to? 

37 12 4.17 17. Is anyone talking about you behind your back? 

17 4 3.25 18. Is anyone working against you behind your back? 

7 42 4,43 19. Do you often wish you could be as happy as other people seem 
to be? 

59 26 4.71 20. Do you worry about a lot of things? 

53 22 5.20 21. Do you have trouble keeping your mind on what you are doing? 

47 19 4.67 22. Do you feel useless and no-account quite often? 

39 «=6:18 3.50 23. Do you often have trouble getting started doing things? 

34 16 3.00 24. Do you sometimes feel so low that you don’t care what happens 
to you? 

52 15 6.17 25. Are you well most of the time? 

60 25 5.00 26. Do you feel dizzy quite often? 

68 28 6.67 27. Does your hip or back bother you very much? 

65 34 4.43 28. Do you get short of breath easily? 

58 8 =25 4.71 29. Do you have many headaches? 

70 34 5.14 30. Do your feet hurt you when you walk a lot? 

46 20 4.33 31. Do you feel “vomity” (or as though you’d throw up) very often? 

54 15 6.50 32. Do you often feel fainty, as though your legs would give way? 

7 2 8.33 33. Do you often feel nervous and trembly and shaky inside? 

40 10 5.00 34. Do you often have headaches that feel as though you had a tight 
band around your head pressing in? 

55 3=«15 6.67 35. Do you usually feel tired and dopey in the morning as though 
you hadn’t slept at all? 

60 20 6.67 36. Black outs-tunnel vision (Question too long to give here). 





*“©” stands for answers of 100 constipated illiterates. 
+“NO” stands for answers of 100 nonconstipated illiterates. 





CONSTIPATION AND ADJUSTMENT 29 


tion are, relative to those with some- 
what more efficient anal mechanisms, a 
quite maladjusted lot. As might be ex- 
pected, certain types of adjustment 
questions appear to be better than 
others in distinguishing the two groups. 
Items 13 through 18 were originally de- 
signed as a rough measure of paranoid 
tendency ; items 19 through 24 were pre- 
sumed to measure depressive tendencies ; 
and items 25 through 36 were chosen to 
represent the hypochondria-hysteria 
variable. An inspection of the ¢t-values 
will show that the depressive items are 
somewhat better than the paranoid, 
while the hypochondria-hysteria set is 
best of all in terms of discriminating be- 
tween the two groups. Nine of the final 
12 items have t-values of 5.00 or high- 
er; four of the final six have values of 
6.50 and higher. The most discriminat- 
ing single item is item 33, “Do you often 
fee] nervous and trembly and shaky in- 
side?” Seventy-two of the constipated 
group said “Yes” to this item while 
only 22 of the comparison group an- 
swered in the affirmative. The observed 
differences of 50 percentage points be- 
tween the two groups makes this ques- 
tion a particularly oustanding one. 
While it is true that items from the 
hypochondria-hysteria set are better 
than other types of items in dicrimin- 
ating between the two groups, it should 
be unequivocally noted that what the 
constipated group seems to suffer from 
is a general type of maladjustment or, 
if one prefers, “neurotic tendency.” In 
question 12, which relates to sleep diffi- 
culties, this excellent indicator of gen- 
eral adjustment shows a greater than 
two-to-one ratio of the constipated ad- 
mitting insomnia in some degree. The 
actual figures for the insomnia question 
are 55 to 25. Item 7 shows that the un- 
lettered constipated male frequently 
feels blue—the ratio here again being 
better than two to one, the actual fig- 


ures, 51 to 24. The neurasthenic morn- 
ing fatigue is quite prominent, as shown 
in item 35, where the figures are 55 to 
15, a ratio of almost four to one. Social 
isolation in a hostile or uncaring world 
is also to be noted in item 14, where 55 
of the constipated admit to feeling 
lonely a good deal of the time, in con- 
trast to 25 of the nonconstipated group. 
It is thus seen that the malaise or faul- 
ty adjustment is more general than the 
strong hypochondriacal core might indi- 
cate that it would be. 

The validity of the test as a whole, as 
might be expected from perusing the in- 
dividual items and t-values in Table 1, is 
quite good in terms of its discriminating 
power between the two groups present!y 
considered. Only 41 per cent of the non- 
constipated group has as many as seven 
or more maladjusted answers to the 36- 
point test; in contrast with this figure, 
some 91 per cent of the constipated 
group had seven or more maladjusted 
answers. These figures correspond to a 
graphically estimated tetrachoric coeffi- 
cient of correlation of .77. Such a cor- 
relation is quite high as a validity co- 
efficient for so short an adjustment test; 
in fact, it is so high that it must be sus- 
pect. The factor which spuriously en- 
hances its present validity is that equal 
numbers of the constipated and the non- 
constipated were used while the true 
percentage of those admitting frequent 
constipation was about fifteen for the 
colored illiterate and ten for the white. 
Where the actual random flow of color- 
ed illiterates is used in the tetrachoric 
quadrants, the resulting r is .61, N of 
89. For the white illiterates, N of 413, 
the tetrachoric coefficient is .55. Despite 
the reduction in the tetrachoric valida- 
ting r’s, it is apparent that the 36-point 
measure of adjustment has good validi- 
ty in discriminating between those who 
suffer from chronic constipation and 
those who do not. 
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It may have occurred to some readers 
that the illiterates who admitted to being 
constipated were malingering or mak- 
ing as bad a case as possible for them- 
selves under the impact of ulterior mo- 
tives. The writer agrees that for some 
of them, such may have been the case. 
However, a previously reported study 
[4] on nocturnal enuresis for the same 
general group of illiterate soldiers show- 
ed that some four-fifths of those who 
claimed frequent enuresis were telling 
the truth, not only of their present con- 
dition but of their past as well, as ascer- 
tained by the Red Cross through 
friends, relatives and family physi- 
cians. Consequently, it is felt that the 
bulk of those who claimed constipation 
were probably constipated. Even if they 
were not, it makes little difference so 
far as the validity of the present study 
is concerned. The important thing is 
that they felt themselves to be consti- 
pated. In matters of the human psyche 
the self-picture is of considerably more 
importance than the “true” picture, 
granted that the “true” picture could be 
obtained. The person who claims fre- 
quent headaches usually admits to other 
symptoms also—it matters not at all 
whether the headache is “true” in the 
physiological sense since the validity of 
the question as an adjustment indicator 
is here all-important to the clinical psy- 
chologist. It is for this reason that such 
inventories as the MMPI and the Bell 
Adjustment Inventory have been re- 
peatedly shown to possess varying de- 
grees of validity. 

It will be remembered that Guirdham 
[7] felt that adult constipation was of- 
ten associated with obsessive-compul- 
sive tendencies. There seems little evi- 
dence in the present data to support his 
contention, so far as the adult illiterate 
is concerned. Associated physical com- 
plaints, depression and paranoia cer- 
tainly are adumbrated among the 36 


items shown in Table 1, but there is 
little there to remind one of an obsessive 
-compulsive. It may be suspected that 
the low intelligence of the illiterate, 
who had an average IQ in the upper 
sixties on the Army Wechsler, has more 
than a little to do with this negative 
finding. The obsessive-compulsive is us- 
ually relatively bright; in contrast, the 
hysteric is usually below the average in 
intelligence (for recent evidence, cf 
Eysenck, H. J., Dimensions of Person- 
ality, London, Kegan Paul, 1947). It 
was the present writer’s observation 
that hysteria in its various forms, par- 
ticularly conversion symptoms, was 
much more frequent among the illiterate 
soldiers than any other type of neurotic 
reaction pattern. This statement should 
not be construed to mean that hysteria 
is linked with constipation; it is merely 
pointed out that with men of defective 
intellect Guirdham’s presumed obses- 
sive-compulsive linkage does not appear 
to hold. 

The logic of sampling would preclude 
generalizing the present data beyond the 
shabby kingdom of the adult, American, 
male illiterate, aetat 18 through 37. It 
is the writer’s belief, however, that with 
the criterion of psychoneurotic groups, 
diagnosed by competent psychiatrists, 
or with the criterion of a more sensi- 
tive adjustment indicator, such as the 
MMPI, applied to “normal” groups, es- 
sentially the same findings would even- 
tuate, regardless of sex or intelligence. 
It might well prove true that constipa- 
tion or its obverse, diarrhea, would ap- 
pear with greater frequency among cer- 
tain kinds of psychoneurotics than 
among others; but that constipation 
would be found to have greater inci- 
dence among psychoneurotics than 
among “normals” seems implicit in the 
quotations given at the beginning of this 
paper as well as in the results of the 
present study. If the results of such a 
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hypothetical study confirmed the hy- 
pothesis just noted, a comparison with 
the data from Alexander and French 
[1] on the depressive and paranoid 
would be of interest. In closing, it might 
be said that our alimentary tract, in all 
its length, appears to be significantly 
linked to our adjustment patterns: (1) 
The number and type of foods we like 
or dislike—our food aversions; (2) the 
incidence and severity of digestive up- 
set, once our food has been committed 
to the digestive system; (3) and, finally, 
the difficulty or ease which we experi- 
ence in eliminating the waste products 
of our digestion. 
SUMMARY AND CONCLUSIONS 

A 36-point measure of adjustment 
was used to compare 100 adult male 
illiterates who admit to frequent 
constipation (medication therefor once 
weekly) with 100 similar illiterates who 
claimed that they were not constipated. 
For every item in the 36-point test the 
constipated illiterate gave more malad- 
justed answers; in 33 of the 36 compari- 
sons the percentage difference between 
the two groups reached the .01 level of 
significance. Items relating to physical 
well being were most discriminating 
between the two groups; items relating 
to depressive and paranoid tendencies 
also discriminated quite well. 

1. The chronically constipated male 
illiterate is, generally, a quite maladjus- 
ted individual when adjustment is de- 
fined in terms of a score on a 36-point, 
orally-administered test. It must not be 
assumed, of course, that the connection 
thus shown between adjustment and 
constipation is necessarily of etiological 
significance. An interactional relation- 
ship would appear to be more likely. 

2. If the data at hand possess more 
than surface validity, it appears likely 
that a group of diagnosed psychoneu- 
rotics would show a considerably higher 
incidence of chronic constipation than 


would a similar group of “normal” con- 
trols. 

3. One’s answer to a question con- 
cerning constipation would appear to 
offer a quite good clue to one’s personal 
adjustment. 

4. Dunbar’s insistence [6] on the 
emotional component in some types of 
chronic constipation appears from the 
present data to be both germane and 
correct. 

5. No evidence is found for Guird- 
ham’s contention [7] that obsessive- 
compulsive trends are frequently asso- 
ciated with chronic constipation. The 
atypically low intelligence of the popu- 
lation in the present study may, how- 
ever, be responsible for this negative 
finding. 
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EASURES of intelligence fre- 
M quently include subtests grouped 
into two rather distinct, though at times 
arbitrarily defined, subscores. The most 
commonly used terms for these sub- 
groupings appear to be “verbal” and 
“performance.” The general assumption 
in making such a dichotomy is that 
“performance” tests measure an aspect 
of intelligence qualitatively different 
from the aspect measured by the “verb- 
al” tests. 

It has been shown that wide deviation 
between the verbal and performance 
subscores for any one individual fre- 
quently may have clinical significance. 
For example, the finding of a verbal 
score significantly higher than the per- 
formance score might be indicative of 
organic disease or neurosis. Mental de- 
fectives and psychopaths generally score 
higher on performance sections. More- 
over, it appears that “verbal” functions 
do not deteriorate as rapidly as do “per- 
formance” functions. A well-known test 
having such significant diagnostic and 
clinical applications is the Wechsler- 
Bellevue [4]. 

The author [1] previously investigat- 
ed certain relationships between this 
widely used individually administered 
test, the Wechsler-Bellevue, and a “pa- 
per and pencil” test of intelligence, the 
California Test of Mental Maturity [2]. 
Although the California Test of Mental 
Maturity does not include subtests re- 
quiring actual manipulation, the divis- 


ion of the test into “language” and “non- 
language’”’ subscores indicates that func- 
tions other than those classified as 
strictly “verbal” are believed to be test- 
ed by the “nonlanguage” section. A 
Pearson product-moment r of + .81 was 
found between the total I1Q’s on these 
two tests; moreover, an r of + .497 was 
found between the language-nonlan- 
guage differences on the Mental Maturi- 
ty and the verbal-performance differen- 
ces on the Wechsler. When significant r’s 
were found between the verbal section 
of the Wechsler and the language sec- 
tion of the Mental Maturity and between 
the performance section of the Wechsler 
and the nonlanguage section of the 
Mental Maturity, the author suggested 
that language-nonlanguage variability 
on the Mental Maturity might be associ- 
ated with maladjustment. 

In order to investigate the possibility 
of this relationship, the author selected 
the records of 397 guidance center coun- 
selees who had been administered both 
the California Test of Mental Maturity 
and the MMPI [3]. All cases known to 
have organic brain damage or who were 
suspected of such were eliminated from 
consideration. For comparative pur- 
poses, the following groupings were 
made: (1) language plus group, consist- 
ing of the records in which the language 
IQ was 20 or more points higher than 
the nonlanguage IQ (N of 72); (2) non- 
language plus group, consisting of rec- 
ords in which the nonlanguage IQ was 
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21 or more points higher than the lan- 
guage IQ (N of 74); (3) a middle 
group, made up of records in which the 
language scores ranged from 10 points 
lower to 9 points higher than the non- 
language scores (N of 136). The mean 
IQ of the language plus group was 
120.85, and standard deviation, 14.75; 
for the nonlanguage plus group the 
mean was 115.25, standard deviation, 
11.40. For these three groupings on the 
California Mental Maturity, the means 
and standard deviations on the nine 
clinical subscales of the MMPI were 
calculated. These findings are presented 
in Table 1. 


TABLE 1 
MEAN SCORES AND STANDARD DEVIATIONS ON 
THE MMPI SCALES FoR THREE GROUPINGS 
ACCORDING TO INTELLIGENCE SUB- 
TEST VARIABILITY 





Nonlanguage 





Language Middle 
MMPI plus group* plus groupt groupt 
Scale Mean SD. Mean S.D. Mean _ S.D. 
Hs 55.46 11.73 51.08 9.03 52.70 9.36 
D 56.57 12.57 52.97 10.71 55.40 11.01 
Hy 59.12 9.21 53.96 8.37 56.60 9.18 
Pd 57.08 11.43 58.21 8.88 56.87 10.92 
Mf 57.68 9.56 57.41 8.10 56.90 9.21 
Pa 53.63 9.21 50.81 7.71 51.20 7.83 
Pt 55.97 12.09 54.08 9.06 54.98 11.22 
Se 56.42 10.41 53.84 9.06 64.14 11.22 
Ma 55.01 9.90 57.59 10.17 57.50 


10.35 








*Language plus group, with language IQ 20 or more 
points higher than nonlanguage IQ. 

+Nonlanguage plus group, with nonlanguage IQ 21 or 
more points higher than language IQ. 

tMiddle croup, with language scores ranging from 10 
points lower to 9 points higher than nonlanguage IQ. 


Inspection reveals that the language 
plus group has higher scores on the ma- 
jority of these clinical subscales. The 
differences are more readily apparent, 
however, in Figure 1 which presents 
the profile of the means scores for the 
three groups. It is seen that the “middle” 
group, (with language and nonlanguage 
scores not too divergent) is also the 
middle group in terms of adjustment 
scores. It is necessary, of course, to de- 
termine if these apparent differences are 
significant. Table 2 presents the differ- 


ences in mean scores for the language 
plus group minus the nonlanguage plus 
group, t-values, and levels of confidence. 
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Fic. 1. MMPI mean scores for three group- 
ings by mental maturity subtest variability. 


TABLE 2 
DIFFERENCES IN MEAN MMPI Scores: LAN- 
GUAGE PLUs GRouP MINUS NON- 
LANGUAGE PLUS GROUP 
MMPI Level of 
Scale Differences* t-value confidence 
Hs +4.38 2.50 1.2 
D +3.60 1.86 n.s. 
Hy +5.16 3.51 .046 
Pd —1.13 .66 n.s. 
Mf +2.97 2.03 4.5 
Pa +2.82 2.00 4.5 
Pt +1.89 1.06 n.s. 
Se +2.58 1.59 n.s. 
Ma —2.58 1.54 n.s 





*Language plus group minus nonlanguage plus group. 


These differences are statistically sig- 
nificant for the Hs, Hy, Mf and Pa 
scales, revealing that the language plus 
group scores significantly higher in 
these clinical areas measured by the 
MMPI. Differences and t-values were al- 
so computed for the language plus 
group minus the middle group, and for 
the middle group minus the nonlan- 
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guage plus group. In these computations 
the only difference which reached statis- 
tical significance was a difference on 
the Hs scale of + 2.64 for the middle 
group minus the nonlanguage plus 
group. This difference provided a t- 
value of 2.10, indicating that it is signi- 
ficant at the 3.6 per cent level of confi- 
dence. The middle group, therefore, 
scored significantly higher on this par- 
ticular subscale, the Hs. 


Further examination of the MMPI 
scores for these three groups indicated 
that the language plus group included 
more individuals who scored 70 or more 
on one or more clinical subscales. The 
percentages of those having one or more 
subscales with a score of 70 or over 
proved to be: (1) language plus, 50 per 
cent; (2) nonlanguage plus, 12 per cent; 
(3) middle group, 18 per cent. As the 
MMPI scores are T-scores, a score of 70 
or more is made by roughly only two per 
cent of the population. The finding of 
the significantly higher percentage of 
70-plus scores in the language plus 
group can be considered as additional 
evidence of maladjustment. 

These facts do not lead to any gross 
generalization that all individuals whose 
language IQ’s on the California Mental 


Maturity are 20 or more points higher 
than the nonlanguage IQ’s are neurotics. 
This would be far from the facts. It has 
been shown, however, that the language 
plus group presented in this study 
scored significantly higher scores on 
four clinical scales of the MMPI, name- 
ly, Hs, Hy, Mf, and Pa. This fact and 
the findings that the language plus 
group also is characterized by consider- 
ably more individuals having one or 
more T-scores over 70 appear to make 
it advisable to interview or to adminis- 
ter a personality test to individuals hav- 
ing such interest variability. 

Received March 17, 1949. 
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A VALIDATION STUDY OF NAVAL NEUROPSY- 
CHIATRIC SCREENING’ 
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AND 
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N an attempt to avoid some of the 

neuropsychiatric difficulties of World 
War I, the U. S. Navy in 1941 instituted 
the neuropsychiatric examination of all 
incoming recruits as a screening device. 
Every recruit was given a neuropsychi- 
atric examination upon his arrival at a 
Naval Training Station [4]. As a re- 
sult of this examination the recruit was 
either cleared and sent on to duty, given 
trial duty with reexamination, or refer- 
red to a psychiatric observation ward 
for further study. If as a result of this 
further study he was adjudged to be un- 
fit for Naval service, his case was pre- 
sented before an Aptitude Board and he 
was discharged as unsuited for active 
duty. In some cases of severe neuropsy- 
chiatric involvement, the recruit might 
be referred to a hospital and discharged 
from there through a process of medi- 
cal survey. By thus getting rid of those 
men who showed neuropsychiatric 
symptomatology of an incapacitating 
nature during training, the Navy hoped 
to reduce the subsequent rate of neuro- 
psychiatric attrition during service. 
Owing to the immediate need for a 
screening program and the tremendous 


1This study is part of a larger project sub- 
sidized by the Office of Naval Research under 
their policy of encouraging basic research. 
The opinions expressed, however, are those of 
the individual authors and do not represent 
the opinions or policy of the Naval service. 


press of military activities, this prophy- 
lactic measure was accepted on an a pri- 
ori basis without experimental valida- 
tion. While it appears a rational and 
proper step from the professional 
point of view, many criticisms were 
raised concerning its necessity and 
its efficiency. These criticisms, plus the 
need for such a screening program in 
the event of further hostilities, make 
some experimental investigation of its 
efficacy mandatory. The authors, in a 
previous article, have dealt with a par- 
tial validation study of the process at a 
single training station [5]. Because of 
the necessary experimental design of 
that study, however, the evidence re- 
mains inconclusive. The present study 
is an attempt to subject the hypothesis 
that Naval. neuropsychiatric screening 
was efficacious in lowering the subse- 
quent rate of neuropsychiatric attri- 
tion during service to more rigorous in- 
vestigation than has been made previ- 
ously. The hypothesis that “screening” 
means less subsequent psychiatric attri- 
tion during service may be stated in the 
following fashion: the more neuropsy- 
chiatrically unfit individuals who are re- 
moved from a sample of recruits during 
the recruit training period, the smaller 
should be the number of medical surveys 
for neuropsychiatric reasons among 
that sample during their later military 
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service. Stated in the form in which 
this investigation shall be cast—if neuro- 
psychiatric screening performed its as- 
sumed function, an inverse relation 
should exist between the recruit screen- 
ing rate at the Naval Training Station 
level and the subsequent rate of neuro- 
psychiatric attrition during service. 
The authors have previously publish- 
ed an article discussing many of the pit- 
falls in the conventional neuropsychiat- 
ric statistics issuing from the military 
services [2]. The present experimental 
design is intended to obviate as many as 
possible of these. Three training sta- 
tions were selected for our study: the 
USNTS, Newport; USNTS, Sampson; 
and USNTS, Great Lakes. At all three 
of these stations the same type of screen- 
ing procedure was in use. All three 
neuropsychiatric units were, to the best 
of our knowledge, at about the same 
level of professional efficiency. The type 
of recruit passing through these stations 
can be considered to be roughly of the 
same sort. Material from other training 
stations was available but was not used 
owing to the fact that the recruit popu- 
lations were not comparable to the above 
three stations, and to the further fact 
that differences existed in the basic 
methods of screening. In our three 
samples the quality of the recruit popu- 
lations, the professional competence of 
the examining staffs, and the examining 
procedures themselves were all roughly 
comparable. An experimental check of 
our hypothesis demands a situation in 
which there exists large differences be- 
tween the training station discharge 
rates in these installations; differences 
not attributable to these supposedly 
equated factors of population, staff and 
procedure. Such a situation existed in 
April of 1943. This date was selected 
because at that time there existed one 
major difference in the screening at 
these three stations, this difference be- 


ing the number of men who were being 
rejected as a result of neuropsychiatric 
screening. At USNTS, Great Lakes, the 
psychiatric unit operated with the full 
support of the local command and was 
allowed to discharge any recruit who 
was considered to be unsuited for Naval 
service. While the psychiatric unit op- 
erating at USNTS, Newport, received 
the support and cooperation of the com- 
mand, the number of special order dis- 
charges effected was held to approxi- 
mately 4 per cent. At the USNTS, 
Sampson, the Commanding Officer was 
not in sympathy with the screening pro- 
cess, and consequently while a number 
of unfit recruits were being detected by 
the neuropsychiatric unit, their separa- 
tion from the service was not approved 
by the Commandant and few discharges 
were actually issued. Since there were 
these wide differences in the number of 
screening discharges issued during 
training in our three selected stations, 
we would assume that if the screening 
process were effective in cutting down 
subsequent neuropsychiatric attrition, 
the later incidence of neuropsychiatric 
difficulties among the men passing 
through these stations should be in in- 
verse relation to the rate of discharges 
during training. 

A large sample of recruits (at least 
1,000 for each station) was selected 
from among the men entering these 
training stations during April of 1943. 
The recruits were selected at random 
directly from microfilm copies of the 
original muster lists of all new recruits 
arriving at the training station. The 
screening rate, as well as the subsequent 
neuropsychiatric attrition, is not de- 
rived from any station report or bureau 
figure, but is taken directly from the 
service records of the men involved. 
Each recruit’s name and service number 
was forwarded to the Naval Records 
Center in Garden City, Long Island, 
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New York, where his individual health 
record was obtained. The record was 
then read carefully by one of the investi- 
gators and the pertinent information 
on it was abstracted. As we have said 
before, as used in this article screening 
rate during the training period refers 
to both the special order discharges by 
reason of inaptitude and the medical 
surveys for neuropsychiatric reasons. 
Subsequent neuropsychiatric attrition is 
defined as all medical surveys issued for 
neuropsychiatric reasons during mili- 
tary service subsequent to the training 
period. 

The original samples selected suffered 
some shrinkage (about 10 per cent) due 
to the unavailability of records. There 
are two main reasons for a record being 
unavailable: the man may be still on ac- 
tive duty, or his record may be lost. 
Since those men who are still on duty 
would represent men who have suffered 
no neuropsychiatric difficulties sufficient 
for discharge, the attrition rates report- 
ed in this article are artificially high, as 
some “normals” are thus excluded from 
the population. This is never more than 
a matter of one or two hundredths of a 
per cent, however, and since it is distrib- 
uted equally throughout all samples, it 
can be overlooked for the purposes of 
this article. Several repeat studies in- 
volving the investigation of the same 
records on two separate occasions have 
indicated that lost records do not repre- 
sent a constant error in any one direc- 
tion. We may therefore assume that our 
obtained samples are representative. 


Table 1 gives the percentage of 
screening discharges during training 
and the percentage of subsequent neuro- 
psychiatric discharges during approxi- 
mately two and a half years of service 
through December of 1945. The expect- 
ed inverse ratio between screening rate 
and subsequent neuropsychiatric attri- 
tion appears and confirms our hypothes- 


is. Apparently screening was effective 
in reducing the rate of psychiatric diffi- 
culties during service. All these differ- 
ences are significant at the 2 per cent 
level or less (less than two chances out 
of a hundred that the differences are due 
to chance factors), except for the dif- 
ferences in subsequent attrition during 
service between Newport and Great 


TABLE 1 
RELATION OF TRAINING STATION SCREENING 
RATE TO SUBSEQUENT NEURO- 
PSYCHIATRIC ATTRITION 
(F1GURED TO CLoOsEsT 1.0 Per Centr) 


% Dis 


charged % Die % Discharged 
during charged Subsequently 
Training Train- Subse- by years* 

Station N ing quently 1048 1044 1045 
Great Lakes 1525 4.5 1.5 0.3 0.6 0.7 
Newport 1173 2.6 1.8 0.5 0.4 0.9 
Sampson 2823 0.7 8.0 0.6 1.0 1.5 
Total 5521 2.2 2.4 0.5 0.7 1.1 
*The reported average yearly discharwe rate for the 
Navy for “diseases of the mind” was 1.4 during the war 


years with the peak of 1.6 coming in 1045 [3]. 


Lakes samples. While the difference be- 
tween Newport and Great Lakes in 
screening rate is significant, the differ- 
ence in subsequent attrition is not. Thus 
the added screening discharges at Great 
Lakes did not produce a significant dif- 
ference in the later psychiatric dis- 
charge rate. This suggests the possibili- 
ty of a curve of diminishing returns in 
neuropsychiatric screening. It may well 
be that there is an optimal screening 
rate above which it is not profitable to 
go, and that the Commanding Officer at 
Newport was correct in attempting to 
set some upper limit to the number of 
screening discharges. 

A further check on this possibility of 
diminishing returns may be obtained by 
a study of the subsequent service rec- 
ords of 242 USNTS, Newport, recruits 
studied by the psychiatric unit in 1943, 
and sent to duty despite questionable 
findings. These men represented a bor- 
derline group, and included many who 
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would have been discharged had a high- 
er discharge rate been allowed. They are 
unselected, consecutive cases and the av- 
erage length of service approximates 
that of the original group. While the 
overall subsequent attrition rate was 
12.8 per cent, seven times that of the 
Newport sample reported in Table 1, 
87 per cent seem to have made a success- 
ful adjustment to service. This bears out 
the hypothesis of an upper limit for 
screening. Confirmatory results are 
found in a previous study by the authors 
[5] and in a recent study by Aita [1]. 
Any final answer to the question of an 
optimal screening rate, however, must 
await a great deal more data than is 
available at present. 

Table 1 also gives the psychiatric at- 
trition rate during subsequent service 
broken down by years. There is increas- 
ing attrition rate over the two and a 
half years covered by this study, show- 
ing that neuropsychiatric disability is a 
function of length of service. In continu- 
ing our previously reported study of the 
recruits who passed through the USNTS, 
Newport, in September of 1941 [5], we 
have been able to follow 915 cases dur- 
ing their subsequent service through 
December of 1945. Here the relation be- 
tween length of service and psychiatric 
disability appears clearly, and the in- 
creasing rate as time goes on is dramat- 
ically illustrated by the sharp rise dur- 
ing 1945, the fourth year of service for 
the group. The yearly discharge rates 
for this September, 1941, group are: 
1941-42, 0.2 per cent; 1943, 0.5 per cent; 
1944, 0.9 per cent; 1945, 2.4 per cent. 
While the absolute number of discharges 
for psychoses is too small to be statis- 
tically reliable, no clear trend is evi- 
dent for the psychoses. The increase 
seems rather to be in the psychoneuro- 
ses and personality disorders. 

In this connection it is interesting to 
compare the rates of discharge for neu- 


ropsychiatric reasons with those for 
disciplinary reasons. In the disciplinary 
category we have included all discharges 
labeled “bad conduct’, “undesirable”, or 
“dishonorable.” Table 2 gives the figures 


TABLE 2 
DISCIPLINARY DISCHARGES AS A FUNCTION OF 
LENGTH OF SERVICE 


Per Cent Discharged 
1941- 


Sample N 42 1943 1944 1945 
Great Lakes '43 1525 0.3 0.9 0.7 
Newport "43 1173 0.3 0.6 1.0 
Sampson "43 2823 0.3 0.4 0.3 
Newport "41 915 1.2 1.2 0.9 0.5 


for disciplinary discharges by years for 
the three samples in this study, plus the 
September, 1941, sample from USNTS, 
Newport. An increase with length of 
service does not appear in the case of 
those disciplinary discharges. 


SUMMARY 


A sample of 5521 Naval recruits en- 
tering three Naval Training Stations 
during April, 1943, has been followed 
during two and a half years of subse- 
quent service to determine whether 
there is any relation between the num- 
ber of men discharged during training 
(as the result of neuropsychiatric 
screening procedures) and subsequent 
neuropsychiatric attrition during serv- 
ice. An inverse relation appears indicat- 
ing that neuropsychiatric screening was 
successful in reducing subsequent neu- 
ropsychiatric attrition. The more re- 
cruits discharged for neuropsychiatric 
reasons during training, the less subse- 
quent neuropsychiatric attrition during 
service. Subsequent attrition rates are 
shown to be a function of length of serv- 
ice. This does not appear true for discip- 
linary discharges. 


Received May 14, 1949. 
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THE WECHSLER-BELLEVUE IN THE DETECTION OF 
ANXIETY: A TEST OF THE RASHKIS- 
WELSH HYPOTHESIS’ 


EDWARD JOSEPH SHOBEN, JR. 


STATE UNIVERSITY OF IOWA 


TUDIES [7, 12] of the Wechsler- 

Bellevue Intelligence Scale [13] as 
a differential diagnostic instrument 
have been many and varied. With re- 
spect to anxiety, perhaps the core phe- 
nomenon in cases of neurosis and mal- 
adjustment, Rashkis and Welsh [10] 
have attempted to objectify the path- 
ognomonic signs which presumably are 
revealed in the psychometric situation 
and are of diagnostic value in the de- 
tection of anxiety states. 

Working with neuropsychiatric pa- 
tients in a military hospital, these work- 
ers set up a series of signs which ap- 
peared to differentiate, in terms of per- 
formance on the Wechsler, between 
those cases in which anxiety was psych- 
iatrically judged to be a prominent 
feature and those in which anxiety was 
not declared essentially contributory. 
Their list of signs, slightly modified for 
use in this study, follows: 


1. Temporary Inefficiency? on Digit Span. 
The subject fails a shorter series but passes 
on a longer series. 


2. TJ. on Information. (a) The subject 
seems to know the answer but is unable to re- 
call it on questioning. He uses such phrases 
as, “I know it, but I just can’t think of it 
now,” or “I have it right on the tip of my 
tongue.” (b) The subject gives an incorrect 
answer which he immediately recognizes and 
corrects. 


8. TI. on Block Design. (a) Simple errors 


1This paper was read at the meeting of the 
Iowa Academy of Science at Drake University, 
Des Moines, lowa, on April 15, 1949. 

The concept of temporary inefficiency is 
borrowed from Rapaport [9], who uses it as 
an indicator of anxiety. 


in the placing of one or two blocks in the last 
four designs. (b) Loss of time owing to ap- 
parently purposeless pauses in the course of 
the solution, fumbling in turning up the prop- 
er block faces or fitting the blocks into the 
design, becoming disorganized in arranging 
the blocks in one part of the design which is 
identical with another part of the design that 
has been successfully negotiated, and failing 
to begin promptly on the signal. 

4. TJ. on Arithmetic. (a) Failing one of 
the first six but passing one of the last four 
items. (b) Using the correct mathematical 
operation but making an arithmetic error 
which is later corrected. (c) Giving the correct 
response but in excess of the time limit. 


5. TJ. on Object Assembly. (a) Inter- 
changing the position of the fingers. (b) Loss 
of time owing to fumbling, failing to begin 
promptly on signal, or stopping during the 
course of the solution. 

6. TJ. on Picture Completion. (a) Failing 
one of the first nine items but passing one of 
the last six. (b) Failing to decide between 
two or more verbalized possibilities. 

7. TJ. on Picture Arrangement. (a) Re- 
versals in order. (b) Correct arrangements 
in excess of the time limits. (c) Minor errors 
in sequence, later corrected but costing time 
credits. 

8. Apprehension. (a) Subject insists on be- 
ing told how well or how poorly he is doing. 
(b) Expressions of inadequacy in such situa- 
tions. (c) More than one inquiry as to the 
purpose of the test. 

9. Compensatory Psychomotor Activity. 
Fidgeting and squirming in the chair, getting 
up to pace or stretch, drumming the desk, tap- 
ping the foot, whistling or giggling, etc. 

10. Distractability. (a) Variation in level 
of interest or attentivity. (b) Attention to 
normally present stimuli which are irrelevant 
or external to the testing situation. 

11. Somatic Complaints. Subject attributes 
failures to not feeling well, headaches, blurred 
vision, etc. 


THE DETECTION OF ANXIETY 41 


12. Autonomic Signs. Flushing, sweating, 
trembling, and tenseness. 


After analyzing their findings against 
a criterion of psychiatric judgment, 
Rashkis and Welsh tentatively conclude 
that when five or more signs are present, 
anxiety is probably the major clinical 
feature; when two to four signs are 
present, anxiety is probably contribu- 
tory; and when one or no signs are 
present, anxiety is probably of no signi- 
ficance in the clinical picture. 

The purpose of this study is to test 
the Rashkis-Welsh hypothesis in a some- 
what different situation and with refer- 
ence to the general utility of the Wechs- 
ler as a differential diagnostic tool. 


PROCEDURE 

Thirty-five Wechsler records were ob- 
tained from college men divided into 
two groups. The “anxious” group, con- 
sisting of 18 cases, was defined as those 
with standard scores of 65 or greater 
on the neurotic triad [6] of the Minnes- 
ota Multiphasic Personality Inventory 
[3] and with 8 or more significantly 
answered items on the Cornell Selectee 
Index [14]. Of this group, ten of the 
eighteen were patients in the Student 
Counseling Office of the State University 
of Iowa, undergoing counseling for per- 
sonal maladjustments. The “nonanxi- 
ous” group, consisting of 17 cases, was 
defined as those with standard scores of 
62 or less on all modalities of the MMPI 
and with only 5 or less significantiy 
answered items of the Cornell Index. 
None of these cases was receiving or 
ever had received formal psychological 
treatment of any kind and all denied any 
feeling of need for psychotherapy. In 
neither group were there any cases with 
histories of nervous system or endocrine 
disorders or psychotic episodes. There 
were no significant differences between 
the two groups as to age or intelligence. 

Careful records were kept during the 


administration of the Wechsler of the 
occurrence of temporary inefficiency and 
the five nontest behavioral signs listed. 


RESULTS 


The distribution of cases within each 
group according to each of the twelve 
signs is shown in Table 1. It is evident 


TABLE 1 


FREQUENCY OF “ANXIOUS” AND “NONANKXIOUS” 
CASEs FOR EACH RASHKIS- 
WELSH SIGN 


“Non- 


“Anx- 
Sign ious” Anxious” x? P 
Digit Span T.I. 5 2 .058 <.80 
Information T.I. 10 10 0 
Block Design T.I. s oy 0 
Arithmetic T.I. f 6 0 
Object Assembly T.I. 5 2 .058 <.80 
Picture 
Completion T.I. € 4 10 >.70 
Picture 
Arrangement T.I. 6 5 0 
Apprehension 4 6 10 >.70 
Compensatory Psycho- 
motor Activity 3 3 0 
Distractability 1 1 0 
Somatic Complaints 2 0 .50 <.50 
Autonomic Signs ] 3 50 <.50 
TABLE 2 


FREQUENCY OF “ANXIOUS” AND “NONANXIOUS” 
CASES BY NUMBER OF RASHKIs- 
WELSH SIGNS 


No. of Signs 


“Anxious” “Nonanxious” 
0 1 2 
1 2 2 
2 3 1 
3 6 5 
4 1 4 
5 4 2 
6 1 1 





from inspection of these data that the 
differences in the occurrence of each 
sign in the “anxious” and “nonanxious” 
groups are not significantly greater than 
those to be expected by chance alone. 
This is borne out for each sign by the 
chi-square® test, computed from two- 

The writer is well aware that for cell fre- 
quencies as smal] as these the chi-square test 
is hardly applicable. Chi-square and P values 
are included here only to give emphasis to the 


essentially chance nature of the distribution of 
cases by sign within each of the two groups. 
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fold tables and corrected by the Yates 
method for discontinuity. 

The same chance distribution of cases 
is seen in Table 2, where the number of 
cases characterized by a given number 
of signs for each group is reported. The 
Rashkis-Welsh hypothesis that the pres- 
ence of five or six signs is probably di- 
agnostic of an anxiety state may be test- 
ed by constructing the four-fold table 
shown in Table 3 and computing chi- 


TABLE 3 


FourR-FoLp TABLE FOR TESTING RASHKIS- 
WELSH HYPOTHESIS 


“Anxious” “Nonanxious”’ 
0 Ee 13 14 
5-6 Signs ............... 5 3 


x? = .1250 od >.70 


square. Chi-square, corrected for dis- 
continuity, is .1250, meaning that the 
chances are more than seventy in 100 
that the obtained differences arose by 
chance factors. The hypothesis must, 
therefore, be rejected so far as this pop- 
ulation and this situation are concerned. 


DISCUSSION 


It may be immediately objected that 
the number of cases used in this study 
is too small to yield reliable results and, 
consequently, that the test of the Rash- 
kis-Welsh hypothesis is inadequate. 
From the overall standpoint of scientific 
desirability, this point may be readily 
granted. From the standpoint of the 
purpose of the investigation, however, 
the objection is irrelevant. The notion 
that anxiety may be detected from 
Wechsler performance has to do with 
individual diagnosis; therefore, a diag- 
nostic aid that fails to discriminate 
better than chance between two differ- 
entiated groups of seventeen and eight- 
een cases must be looked upon at best as 
extremely suspect. 

This gives rise to the question of the 


basis on which the groups here employ- 
ed were differentiated. Were the cases 
in the “anxious” group “really” anx- 
ious? If it is true, as is widely held 
[5, 11], that anxiety is the central fac- 
tor in most cases of maladjustment and 
neurosis, it seems difficult to challenge 
the criterion used in this study. Not 
only did the anxious subjects show 
pathological signs on two standard per- 
sonality tests, but a majority of their 
number were actually in therapy. On the 
other hand, the nonanxious subjects 
differed in a favorable direction on both 
personality tests, in no case showed 
histories of having been in therapy, and 
unanimously denied any feeling of need 
for counseling. It seems legitimate to 
expect that a diagnostic instrument 
purporting to indicate anxiety should 
discriminate between groups so defined. 

How then can the differences between 
the findings of Rashkis and Welsh and 
those here reported be explained? Two 
major possibilities are suggested. 

The first is that the variation in situ- 
ation from one study to the other ac- 
counts for a large part of the difference. 
Rashkis and Welsh were working with 
institutionalized patients in a military 
installation. It is quite possible that the 
“definite differential trend” which they 
found among anxiety states, states in 
which anxiety was probably contribu- 
tory, and states in which anxiety was 
probably not a significant feature, re- 
flected the effects of hospitalization 
rather than some general characteristic 
of the neurotic or maladjusted called 
anxiety. The military context may also 
have contributed to the findings, impos- 
ing situational stresses manifesting 
themselves in terms of the Rashkis- 
Welsh signs. The central point here is 
that people in a hospital are very prob- 
ably not comparable to people who are 
not, and conclusions drawn from one 
group may be applied only with the ut- 
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most care and tentativeness to the other. 
Institutionalization may well constitute 
an additional variable which must be 
taken into account when investigative 
designs are being set up and when gen- 
eralizations are being made. For exam- 
ple, institutionalized psychotics may dif- 
fer not only from normals but from non- 
institutionalized psychotics, and at- 
tempts to develop diagnostic techniques 
on hospitalized patients which may then 
be applied to nonhospitalized suspected 
psychotics may be foredoomed because 
of the failure to take into account the 
additional variable of hospitalization. 

This is quite similar to a point that is 
becoming increasingly understood in the 
field of personnel selection. Attempts to 
develop selective procedures by studying 
successful workers and applying the 
findings to applicants have met with 
signal lack of success. On the other 
hand, attempts to develop predictive in- 
dices which will discriminate between 
those applicants who will do well on the 
job and those applicants who will do 
poorly have shown increasing promise. 
The additional variable of time-on-the 
job (institutionalization) makes the re- 
sults of investigations of seasoned work- 
ers inapplicable to inexperienced appli- 
cants. This point seems to require spe- 
cial awareness from clinical psycholo- 
gists, whose work frequently takes place 
within settings which make the general- 
ization of their findings to different set- 
tings a dubious procedure unless due 
care is taken. 

A second possible explanation of still 
greater generality has to do with the 
utility of the Wechsler as a diagnostic 
instrument. The ideas expressed here 
stem from (a) the fact that the findings 
of Rashkis and Welsh were by no means 
statistically conclusive in spite of the 
“definite differential trend” revealed in 
their hospital population and (b) the 
findings of other investigators concern- 


ing the Wechsler subtests. 

The concept of temporary inefficiency 
rests heavily on the assumption that the 
order of difficulty among the items on a 
given subtest is constant for all groups. 
That this is highly questionable is evi- 
dent from a study by Rabin and others 
[8] which reports an order of difficulty 
quite different from that given by 
Wechsler in his manual. This is also 
given weight by the findings of Davis 
and Havighurst [2] on social class dif- 
ferences in responses to standard intel- 
ligence test items. According to these 
workers, order of difficulty will vary 
with the opportunities for specific kinds 
of learning which are presented by 
varying social environments.‘ Moreover, 
it is difficult to tell whether or not such 
things as minor errors in the placing of 
blocks in the more difficult designs, the 
interchanging of fingers on object as- 
sembly, fumbling with test materials, 
and miscalculation in arithmetic are not 
more properly understood in terms of 
some trait like carelessness or poor per- 
ceptual processes or lack of number abil- 
ity or poor motor skills rather than as 
revelatory of anxiety. Likewise, expres- 
sions of blocking—such as, “I know that 
but somehow just can’t recall it right 
now,” or pausing for no apparent reason 
in the course of working out a solution— 
may just as logically be indicators of 
cognitive deficiencies as well as of dy- 
namic interferences. Thus, the whole 
notion of temporary inefficiency as cur- 
rently defined and in the present state 
of knowledge seems shaky in its founda- 
tion and of doubtful utility in the detec- 
tion of anxiety. 


Furthermore, the usefulness of the 
Wechsler as a differential diagnostic in- 


4A good illustration of this is to be found 
among mental defectives from rural Iowa. 
While many of these cases do quite poorly on 
picture completion, virtually none of them has 
ever failed to perceive that the pig in the pic- 
ture completion series has no tail. 
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strument assumes subtest reliabilities of 
sufficient magnitude to allow the confi- 
dent inference that an individual will 
show little variability over a period of 
time in subtest performance, not only 
in terms of scores but in terms of the 
items contributing to his score. On a 
priori grounds, this idea seems question- 
able since the subtests are, excepting 
vocabulary and information, quite short. 
Curiously, there has been little investi- 
gation of this point. In the only publish- 
ed study of subtest reliabilities, Hamis- 
ter [4] reports test-retest correlations 
chiefly of the order of .65 to .75, the two 
notable exceptions being vocabulary and 
information, the longest of the subtests, 
in which reliability coefficients of .94 
and .90 respectively were obtained. For 
all subtests, standard errors of measure- 
ment were quite large. Again, however, 
Hamister was working with neuropsy- 
chiatric patients in a VA hospital, so 
the applicability of his results is re- 
stricted. In the absence of further evi- 
dence, it seems necessary to conclude 
that the bases for using the Wechsler as 
a differential diagnostic instrument 
must be viewed askance. 

Nevertheless, it is a commonplace 
that clinicians are able, after adminis- 
tering a Wechsler, to make valuable ad- 
ditions to the diagnostic description of a 
patient. How may this be reconciled 
with the foregoing comments to the ef- 
fect that at present the Wechsler con- 
tributes little to the detection of anxiety 
and to differential diagnosis in general? 
It is suggested that the experienced 
clinician who observes a patient in the 
testing situation responds to a number 
of unverbalized cues, on the basis of 
which he may make diagnostic state- 
ments of reasonable validity. He then 
attempts to objectify the grounds for 
his statements in terms of test signs in- 
to which he projects his own accuracy. 
If this is true, future research may most 
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profitably follow two lines: one has to 
do with the intensive investigation of 
tests like the Wechsler with different 
nosological groups, taking into account 
the points which have been here raised; 
the other, possibly more fruitful, has to 
do with the study of what Cofer [1] 
has called “the clinician as measuring 
instrument,” attempting to make explic- 
it the specific unverbalized cues to 
which experienced clinical workers re- 
spond. 


SUMMARY 


A check of the Rashkis-Welsh hy- 
pothesis that anxiety may be detected 
by means of various signs on the Wechs- 
ler-Bellevue resulted in a rejection of 
the hypothesis for the group studied. 
Differences in the two sets of findings 
are discussed in terms of the generality 
of experimental populations, variation 
in order of difficulty among Wechsler 
subtest items, alternative explanations 
of the behavior which is supposed to sig- 
nify the anxiety-bred temporary ineffi- 
ciency, and relatively low subtest relia- 
bilities. Some suggestions for future re- 
search are advanced tentatively. 

Received April 19, 1949. 
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THE RELATIONSHIP BETWEEN VARIABILITY AND 
ABILITY ON THE WECHSLER-BELLEVUE' 


FRANCIS M. GILHOOLY 


FORDHAM UNIVERSITY AND VETERANS ADMINISTRATION HOSPITAL, BRONX, NEW YORK 


HILE the Wechsler-Bellevue in- 
telligence scale is used exten- 
sively to obtain a general estimate of 
intelligence at the adult level, an in- 
creasing number of clinicians have been 
employing it primarily as an aid in 
differential diagnosis of neurotic and 
psychotic disorders [2,3]. In connection 
with the latter use of the Bellevue Scale, 
variability and its relationship to ability 
become of paramount importance, be- 
cause the diagnostic signs of the differ- 
ent clinical entities are essentially based 
on variability, on the scatter of the sub- 
tests about the subtest mean. 
Diagnostic signs are valuable only if 
they consistently aid in diagnosis. All too 
frequently in clinical practice, especially 
when the upper extremes of the IQ 
range are approached, few, if any, of 
the pathognomonic signs are found, 
while they appear with much greater 
frequency in the average range of in- 
telligence. This may possibly be due to 
the fact that the amount of difference 
necessary for a significant deviation in- 
creases with increasing IQ. 
1Published with permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who as- 
sumes no responsibility for the opinions ex- 


pressed or the conclusions drawn by the au- 
thor. 

The present paper is based on one section 
of a thesis submitted to Fordham University 
in partial fulfillment of the requirements for 
the degree of Master of Arts. The writer 
gratefully acknowledges his indebtedness to 
Drs. Anne Anastasi and Dorothea McCarthy 
of Fordham University, to Dr. Joseph Levi, 
former Chief Psychologist of the Kingsbridge 
Veterans Hospital, New York, and to Dr. Da- 
vid Wechsler, consultant to the Veterans Ad- 
ministration. 
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Wechsler’s assumption that the rela- 
tionship between variability and ability 
on the Bellevue scale is linear had not 
been tested directly. It was based on a 
study by Bown [1] which, the present 
author believes, does not apply to the 
Wechsler-Bellevue scale. 


1. Bown purposely selected subtests with 
low intercorrelations, which, he states, are de- 
manded since the problem requires a consider- 
able range of variability to appear. The sub- 
tests of the Bellevue scale, on the other hand, 
all have positive intercorrelations ranging 
from .155 to .721. Bown accounted for the ap- 
pearance of some curvilinear relation between 
the variables by the low intercorrelations of 
the tests. 


2. Bown’s sample consisted entirely of col- 
lege freshmen, certainly a restricted one and 
not representative of the entire range of Bel- 
levue scale IQ’s. 

3. Wechsler, in transferring the results of 
Bown’s study to his test, apparently did not 
take i consideration the scoring limits of 0 
and 18 on the various subtests of his scale. 
These limits may seriously curtail variability 
at the extremes of the scale and so may con- 

ibt 1 curvilinear relationship. 

it was the purpose of the present 


study to investigate the relationship be- 
variability and ability on the 
ler-Bellevue intelligence scale, us- 
ing a population of psychoneurotic pa- 


SUBJECTS 
1e subjects for this investigation 
consist entirely of white, male veterans 
of World War II. Each of the 122 sub- 
jects was a patient in the neuropsychi- 
atric section of the Kingsbridge Vet- 
erans Hospital, Bronx, New York. The 
criteria used in the selection of all cases 
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were: 


1. Final, or discharge, diagnosis of psycho- 
neurosis. Cases with psychoneurosis superim- 
posed upon another syndrome were discarded. 
The clinical psychologist’s case report was not 
utilized in order to avoid a biased sampling 
since his diagnosis, at least in part, was based 
on the technique under investigation. 

2. Age range from 19 to 35, inclusive. Age 
was limited to 35 or less in order to eliminate 
as far as possible the effects of decreasing ef- 
ficiency due to advancing age. 

38. Each subject must have received a 
Wechsler-Bellevue intelligence test, Form I, as 
part of his diagnostic procedure. Only those 
cases to whom the entire 11 subtests were ad- 
ministered were acceptable. 


The age of this group ranges from 19 
to 35 years with a mean of 27.08 and a 
standard deviation of 4.35 years. The 
range of intelligence quotients is from 
75 to 135, with a mean of 107.19 and a 
standard deviation of 13.48. The IQ dis- 
tribution, in terms of Wechsler’s classi- 
fication, is as follows: Very Superior, 
11; Superior, 11; Bright Normal, 31; 
Average, 57; Dull Normal, 10; Border- 
line, 2. 

A comparison of this group with 
Wechsler’s standardization population 
shows the present sampling to excel in 
educational achievement. While approxi- 
mately 62 per cent of Wechsler’s sam- 
pling never entered high school, only 25 
per cent of the subjects of this study 
left school before the ninth grade. 


PROCEDURE AND RESULTS 


For each subject, the obtained Intelli- 
gence Quotient on the Bellevue scale was 
the individual measure of ability. The 
individual measure of variability was 
the standard deviation of the subtest 
scores about their mean. Since the re- 
lationship between variability and abili- 
ty was suspected to be nonlinear, the 
correlation ratio, eta, was computed. 

The obtained correlation ratios, eta,. 
= .014 and eta,, = .843, were corrected 
for size of sampling and for fineness of 


grouping, and the Standard Errors of 
eta were calculated. The resulting data 
2re presented in Table 1. 


TABLE 1 
CORRELATION RATIOS BETWEEN VARIABILITY 
AND ABILITY ON THE WECHSLER 
BELLEVUE SCALE 


Standard 
Obtained Corrected Error of 
eta eta eta 


Changes in Ability (Y) 
resulting from changes 


in Variability (X) 014 ,022 10 
Changes in Variability 

resulting from changes 

in Ability 843 83 03 


It is apparent that eta,,, showing the 
dependence of ability upon variability, 
is not worthy of confidence since its 
standard error is much larger than the 
correlation ratio itself. Independence or 
extremely little relationship should be 
expected because the intellectual level 
of a subject does not depend on how 
variable he is. Eta,,, however, which 
gives the change in variability resulting 
from changes in ability or IQ, is very 
significant. The amount of variability 
shown on the Bellevue scale is thus 
closely dependent upon the intellectual 
level of the subject. 

The Pearson r was computed and 
found to be —.061. Curvilinearity of re- 
gression was tested by means of the 
Chi-square technique, with the following 
results: Chi-square eta,, = 275.72, 
which is significant at the .01 level ; Chi- 
square eta,, = .403, and is not signifi- 
cant. It may be added parenthetically 
that the inclusion of the two cases in the 
Borderline category of intelligence, al- 
though clearly increasing the trend to- 
ward curvilinearity, is not of primary 
importance in determining such curvi- 
linearity. Omitting these two cases re- 
duces eta,, from .843 to .708, the latter 
value still being very high and its dif- 
ference from r extremely significant. 

To determine the form of this regres- 
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sion, the curve which describes the re- 
lationship between variability and abili- 
ty was sketched. An examination of this 
curve, reproduced in Figure 1, reveals 
that as the extremes of the IQ distribu- 
tion are approached there is a strong 
tendency for variability to diminish, the 
greatest variability occurring in the Av- 
erage IQ range, 91-110. 
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Fic. 1. Relationship between variability and 
ability (Eta = .883; N = 122). 


These results would appear to support 
Rapaport’s contention that the scoring 
limits of 0 and 18 on the various sub- 
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tests impose restrictions which limit 
variability at either extreme of the IQ 
continuum [2, p. 50]. 


CONCLUSIONS 


The results of this investigation indi- 
cate disagreement with Wechsler’s as- 
sumption that the relationship between 
variability and ability on the Bellevue 
scale is both linear and small. The 
amount by which a given subtest score 
must deviate from the mean in order to 
represent a significant deviation is not 
proportional to the magnitude of the 
total score. Rather, the amount of devi- 
ation necessary for significance becomes 
less the further the obtained IQ deviates 
from the Average in either direction. 


Received May 23, 1949. 
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CLINICAL OPINION ON THE ROLE OF THERAPIST 
ADJUSTMENT IN PSYCHOTHERAPY 


WILLIAM SEEMAN 


UNIVERSITY OF MINNESOTA 


LTHOUGH emphasis in the re- 
search and other literature of psy- 
chotherapy has understandably and ap- 
propriately been on the behavior and ac- 
tivity of the client, it is a commonplace 
conception that the therapeutic process 
is an interactive one, and even those 
therapists who tend to regard the coun- 
selor as hardly more than a catalyst in 
the therapeutic process would be likely 
to agree that among the multiplicity of 
variables of which this process is a 
function must be included the personali- 
ty dynamics of the therapist himself. 
Recently, some attention has been given 
to the counselor’s (i.e. therapist’s) role: 
Porter [3] and Royer [4] have reported 
studies of counselor activities; Snyder 
[6] and Seeman [5] have presented 
categories of counselor responses in in- 
terview therapy; and attention to coun- 
selor attitudes has been paid by McClel- 
land and Sinaiko [2]. In addition, Wy- 
att [7] has commented on the self-ex- 
perience of the therapist. The psycho- 
analysts have long paid considerable at- 
tention to the behavior of the therapist, 
and presumably one of the functions of 
the psychoanalysis which is an indispen- 
sable part of psychoanalytic training is 
that of sensitizing the therapist to the 
significant facets and aspects of his own 
behavior in the therapeutic setting. 
Scattered evidence would suggest that 
clinicians are in very real disagreement 
concerning the role of therapist adjust- 
ment in the therapeutic process. Wyatt, 
in the paper already cited, hints at the 
dangers and pitfalls which beset the in- 
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secure therapist, stressing the necessity 
for insight into one’s own personality 
structure, although he does not explicit- 
ly insist that only a super-adjusted clin- 
ician can carry out effective therapy. 
Hathaway [1] however, explicitly says: 

I wish I could believe these theoretical for- 
mulations we have been hearing or believe 
even some of the smaller points—for exam- 
ple, that a therapist should himself be well- 
adjusted and consistent. We all know that 
honest appraisal of some foremost therapists 
would indicate doubt of that point. 

Believing that competent clinical 
opinion with respect to the problem of 
the therapist’s adjustment and its effect 
on therapy is important enough to make 
public data, the writer undertook to ob- 
tain responses to nine questions design- 
ed to tap professional ideas on this 
question. The preliminary report pre- 
sented in this paper consists of an an- 
alysis of responses made by 70 thera- 
pists, the great majority of these repre- 
senting outstanding writers in the field; 
a number have standard and widely 
used texts in psychoanalytic theory, psy- 
chology of adjustment, abnormal psy- 
chology, counseling, etc. A breakdown 
of the sample is given in Table 1. 


TABLE 1 


TRAINING OF THE 70 PSYCHOTHERAPISTS 
RESPONDING TO NINE QUESTIONS 


Ph.D 


dill i atROL, od easy lia esdssbegusibanie 34* 
a ERT eC 1i 
Be CUNO IORI hones cccesdccecnsccscecees 5 
OSE aS eee Oe eee 18 
EE ee oe eo 2 


” @Ineludes five lay psychoanalysts ‘Le. psychoanalyti- 
cally trained Ph.D.’s. 
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The nine questions are presented in 
Table 2, with the percentage breakdown 
in responses. Five response categories 
were used: Strongly agree, agree, unde- 
cided, disagree, and strongly disagree, 
the order of these categories being ran- 
domized. (These categories are abbrevi- 
ated in the table, SA indicating “strong- 
ly agree” and so on.) 

It is clear from these data that the 
highest community of response (i.e. Q- 
9) indicates a very real agreement that 
the prospective therapist should have 
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access to some personal therapy, 85 per 
cent of the responses indicating agree- 
ment or strong agreement on this ques- 
tion. However, while some would require 
the prospective therapist to experience 
therapeutic sessions, others specify that 
such therapy be made available on an 
exclusively voluntary basis. In contrast 
to this high community of response we 
find strong disagreement in Q-5, 50 per 
cent of the responses dissenting from 
psychoanalysis of the therapist as a 
prerequisite, and 40 per cent advising 


TABLE 2 
RESPONSES OF SEVENTY THERAPISTS BY CATEGORIES 


QUESTION 


1. Counselors and therapists ought to be in- 
dividuals who have achieved superior per- 
sonal adjustment 


2. Individuals who have achieved an average 
adjustment would probably make quite sat- 
isfactory counselors or therapists ................ 


3. Individuals who have mild maladjustments 
may through these achieve greater insight 
and make more effective counselors or 
therapists than individuals of superior ad- 
justment 


4. All counselors and therapists should under- 
go some sort of personal psychological eval- 
uation with a skilled therapist -.................... 

5. It would be desirable that all counselors 
and therapists be psychoanalyzed if there 
were enough psychoanalysts available to 
OE RE ee ae SO EN ee 

6. Counselors or therapists who are at all mal- 
adjusted will probably work out their mal- 
adjustments on the client to the latter’s 
detriment 


7. Evidence clearly indicates that well ad- 
justed counselors and therapists are more 
effective than poorly adjusted ones ............ 


8. Individuals who have had some kind of per- 
sonal difficulty which they have solved 
through psychoanalysis or other therapy 
are more likely to be effective therapists 
than those who have not experienced such 
personal difficulty and solved it .................... 


9. Training programs for clinicians who ex- 
pect to practice therapy should provide at 
least some personal therapy for the pros- 
pective counselor or therapist 


SA A U D S D 
12.8% 38.6% 20.0% 27.2% 1.4% 
ES 

43% 60.0% 17.1% 15.7% 2.8% 
5.7% 48.67% 22.9% 17.1% 5.7% 
35.7% 31.4% 14.3% 18.6% 0.0% 
15.7% 24.3% 10.0% 34.3% 15.7% 
11.4% 17.1% 32.9% 35.7% 2.8% 
10.0% 24.3% 31.4% 20.0% 14.3% 
18.6% 45.7% 21.4% 12.9% 1.4% 
41.4% 44.3% 10.0% 4.3% 0.0% 
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it. As one might expect, whether the 
therapist answering this question has 
himself been psychoanalyzed or not con- 
tributes significantly to the direction as 
well as the intensity of the response. 
Classifying the responses on the basis of 
whether the therapist has been psycho- 
analyzed' or not, and using two degrees 
of freedom (i.e. three categories), a chi- 
square value of 14.29 was obtained, sig- 
nificant at the 1 per cent level. It may 
be said, therefore, that being psychoan- 
alyzed does significantly influence the 
degree to which the therapist was will- 
ing to commit himself to the require- 
ment of psychoanalysis as a part of the 
professional training of the counselor 
or therapist. 


The two questions on which the thera- 
pists represented in this sample appear 
least certain are Q-6 (will maladjusted 
therapists work out their problems to 
the detriment of the client?) and Q-7 
(evidence bearing on the influence of 
adjustment on the effectiveness of ther- 
apy). However, the indecision and dis- 
agreement with respect to the latter 
question are more apparent than real, 
as strongly suggested by the character 
of the many qualifying remarks which 
accompanied the responses to the ques- 
tion. It would appear that there are real- 
ly two aspects of the question which 
could be preponent: Those who concen- 
trated on the availability of evidence in- 
dicated disagreement or strong disagree- 
ment, whereas those who selected the 
phrase “well adjusted counselors are 


1In computing chi-squares, SA and A are 
grouped together, as are SD and D; this is 
done to conform to the requirement of ade- 
quate numbers in the cells of the contingency 
table. It should be understood, too, that in- 
cluded in the psychoanalyzed group are ther- 
apists who do not call themselves psychoana- 
lysts, but who have been psychoanalyzed. 
There are 24 such therapists. In addition, two 
are at present beginning psychoanalysis; these 
are included in the analytical group only for 
the computation of the critical ratio which ap- 
pears at the end of this paper. 


more effective than poorly adjusted 
ones” as the primary source of atten- 
tion apparently were undecided. How- 
ever, the accompanying qualifications 
(e. g. “The real evidence is scanty” 
or “What evidence?” or even the cross- 
ing out of the word “evidence”’) strong- 
ly indicate, as we have already sug- 
gested, that there is no real indecision 
concerning the availability of evidence— 
i. e. most of the therapists agree that 
there simply is no such evidence. The 
majority opinion represented in this 
sample, in short, would appear to sup- 
port Hathaway’s position. 

Since an inspection of the data sug- 
gested the possibility of certain interest- 
ing differences between the psychoana- 
lytically oriented therapists and the non- 
analytically oriented therapists in ad- 
dition to the difference already discus- 
sed it was decided to compute chi- 
squares for all the questions. Table 3 
presents these chi-square values. 


TABLE 3 
CHI-SQUARE VALUES FOR DIFFERENCES ON 
EACH OF NINE QUESTIONS BETWEEN 
PSYCHOANALYZED AND NONANA- 
LYZED THERAPISTS 


Q. Chi-Sq. DF Probability 
1 2.6 2 <.30 — >.20 
2 3.6 2 <.20— >.10 
3 3.4 2 <.20 — >.10 
4 14.0* 2 1 

5 14.2 2 01 

6 9.4 2 01 

7 2.4 2 <.30 — >.20 
g 9.8 3+ 02 

9 1.4 2 <.30 — >.20 


*Although two cells in the 2 x 3 contingency table for 
this question contained fewer than the requisite number 
of cases, the chi-square is significant well beyond the 1 
per cent level even when the contribution of these two 
cells to the composite chi-square are ignored. 

+The numbers in the cells were such that a 2x4 con- 
tingency table could be used, thus giving three degrees 
of freedom here. 


It will be obvious that having been psy- 
choanalyzed significantly influences an- 


swers to Q-4 (should prospective thera- 
pists undergo evaluation?), Q-5 (is 
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psychoanalysis desirable?), Q-6 (the 
probability of working out maladjust- 
ment on the client) and Q-8 (are any 
advantages to be expected from having 
experienced and worked through some 
personal psychological difficulty?). If 
one were (perhaps not unwhimsically) 
to divide the answers to this last ques- 
tion into “optimistic” and “pessimistic” 
categories, it may be said that the ther- 
apist who has been psychoanalyzed is 
significantly more optimistic with re- 
spect to the salutary effect of having had 
such an experience. With respect to Q-4 
(i.e. personal psychological evaluation) 
it is interesting that there are differen- 
ces even where there is agreement—that 
is there are differences of degree be- 
tween the analytical and nonanalytical 
group. The psychoanalyzed therapists 
tend to be stronger in their recommen- 
dation of personal evaluation. This dif- 
ference is significant by the chi-square 
test at the 1 per cent level. 


This raises another interesting ques- 
tion: Is there a general tendency for the 
psychoanalytically oriented therapist to 
be stronger in his position with respect 
to these questions, irrespective of the 
direction in which he answers them? 
The answer to this question is that he 


TABLE 4 
DIFFERENCES BETWEEN PSYCHOANALYZED AND 
NONANALYZED THERAPISTS IN STRENGTH 
OF RESPONSE TO NINE QUESTIONS 


—-Strong* % Strong % 

Responses Responses Diff CR 
Psychoanalytic 96 We ; 
Nonanalytic 54 13.6 





27.4 7.3 








*i.e. Strongly agree and strongly disagree. 


is, as can be easily seen in the data sum- 
marized in Table 4. The difference indi- 
cated is, of course, significant at the 1 
per cent level. There would appear to be 
a reliable tendency for the psychoana- 
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lyzed therapist to take a stronger posi- 
tion on these questions than does the 
nonanalyzed therapist irrespective of 
the direction in which the questions are 
answered. 


SUMMARY 


This paper presents an analysis of re- 
sponses of 70 clinicians to nine questions 
dealing with the influence of therapist 
adjustment on effectiveness of therapy. 
The highest community of response is 
found with respect to making available 
therapy to the prospective clinician who 
is to do psychotherapy; there is also 
substantial agreement that real evidence 
is still lacking on whether the most ef- 
fective therapists are the best adjusted 
ones. A number of significant differences 
are found between psychoanalytically 
oriented therapists and nonanalytically 
oriented ones. In general, also, psycho- 
analyzed therapists tend to take strong- 
er positions whether pro or con. 
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PLAY THERAPY EXPERIENCES AS DESCRIBED 
BY CHILD PARTICIPANTS 


VIRGINIA MAE AXLINE 


TEACHERS COLLEGE, COLUMBIA UNIVERSITY 


HERAPISTS have their intentions 
a in therapy clearly defined in their 
own minds. They have their theories 
and goals and methods of evaluating the 
outcomes of therapeutic experiences. In 
all likelihood there would be general 
agreement among all therapists that a 
“successful” therapeutic experience for 
a child would bring about marked and 
noticeable changes in the child’s behavi- 
or—physically as well as psychologically. 
For example, reports from parents at 
the conclusion of “successful” therapy 
for the child include observations that 
the child is more relaxed, eats better, 
sleeps better, shows improvement in his 
coordination, no longer manifests overt 
behavior symptoms of tension or anxi- 
ety such as nail-biting, bed wetting, 
hair-pulling, or any of the other possible 
symptoms that he may have had prior 
to the therapeutic experiences. Usually 
the child is reported as being more co- 
operative, happier, more spontaneous 
in all of his behavior. In other words, 
the descriptions given of the child at 
home and at school indicate that the 
child has achieved adequate adjustabili- 
ty so that he functions with ease and en- 
joyment both individually and in 
groups. He has become a happy child in 
harmony with his world. From such ob- 
servational evaluation, the therapist 
draws up a picture of what has happen- 
ed to the child during the period of his 
therapeutic experience. 

There are differences of opinion as to 
the dynamics that are in operation 


which facilitate these observable chang- 
es. Theories and explanations of process 
are varied. The perceptions of different 
therapists are often at variance. The 
question that is raised frequently is one 
that is a challenging and provocative 
one: What element or elements in all 
successful therapeutic approaches are 
the essentials that bring about these 
changes? Are the changes that are ob- 
served immediately after the termina- 
tion of therapy lasting changes? 

Speculation alone does not provide the 
answers, but research, followup studies, 
and investigations from various angles 
into the process might throw additional 
light in this direction. 


METHOD OF THE FOLLOW-UP STUDY 


As has been stated above, the therap- 
ists have their intentions in therapy, 
but how do the children perceive and 
experience the play therapy sessions? 
And what is the significance of this ex- 
perience to them? How does the child 
size up the situation while he is partici- 
pating in it? How does the child describe 
the experience at a later date? What 
would be indicated by follow-up studies 
of children who had completed therapy 
which had been evaluated as “success- 
ful” by parents, teachers, and thera- 
pists? 

The study reported here attempts to 
explore possible answers to the above 
questions. 

Out of 30 play therapy case records 
evaluated as successful, 22 of the clients 
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were available for a foliow-up study. 
The other eight children had moved 
away and there were no forwarding ad- 
dresses. 

The procedures used in these inter- 
views were as follows: The therapist 
met the child in an interviewing room 
and asked one introductory question, 
“Do you remember me?” There were no 
probing questions, suggestions, or di- 
recting of thinking other than those 
quoted in this paper. The purpose was 
to get any reactions the children might 
have had to their therapeutic experien- 
ces. 

In the cases where letters were sent 
to the children, a copy of the following 
handwritten letter was sent to each 
child not contacted in the school person- 
ally. 


EN OT ara : 


We are interested in finding out what if any- 
thing you remember about the experience you 
had when we met in the playroom at (name of 
school or clinic) in the (date — season and 
year). 

We would appreciate it very much if you 
could come in for a little talk with me—about 
that experience and about what you are doing 
now. 

Will you please call (telephone number) and 
make an appointment so we can talk together 
again.—Or write on the enclosed card when it 
would be convenient for you to come in. 

If you cannot come in, will you write me a 
letter telling me what, if anything, you remem- 
ber about the experience? 

It is quite possible that you have forgotten 
all about it. It has been a long time ago. If 
that is the case, will you just write on the 
ecard, “I don’t remember anything about it,” 
and mail it to me? 

Thank you so much for your kindness. 


Sincerely yours, 


Name of Therapist 


In all of the twenty-two cases refer- 
red to in this report, the child was the 
only one in the family who received 
therapy. The parents were not receiving 
any kind of treatment. 


These cases were selected because first 
of all they were considered “successful” 
cases according to evaluations immedi- 
ately following the termination of thera- 
py and also at follow-up studies a year 
later. The reason for confining this study 
to “successful” cases only was to at- 
tempt to gain some insight into the chi!- 
dren’s perception of the experience, 
their interpretation of it, and their 
memory of it. Those cases wherein the 
child was the only recipient of therapy 
were selected to keep to a minimum any 
reactions to the therapeutic experience 
by other members of the child’s family. 
If no other member of the family had 
had a therapeutic experience they were 
not likely to influence the child’s impres- 
sions of it by their conversation, so that 
the attitudes toward the therapy which 
the child expressed would be the child’s 
own attitudes. 


CHILDREN’S COMMENTS DURING THE 
THERAPY SESSION 


The first group of quotations from the 
children are drawn from recorded ma- 
terial during the play therapy sessions 
—those spontaneous comments that 
came forth unsolicited as the children 
were experiencing the therapeutic play 
sessions. 


Betty, aged four, was referred for play ther- 
apy because she was “a feeding problem, had 
nightmares, had temper-tantrums, could not 
get along with other children because she was 
so bossy and scrappy” according to the moth- 
er’s report. Betty was seen by the same thera- 
pist twice a week for a period of fifteen weeks. 
She was seen individually during one of her 
weekly sessions and at the other time in a 
group of three. Betty was told that each week 
for the group meetings she could bring with 
her two other people. One of the significant 
developments in her therapeutic experience 
emerged from her selection of the other two 
members. During one of the group sessions 
at which time she had brought two girls—one 
her age, the other girl a year older—the chil- 
dren were finger-painting. Each child had a 
complete set of colors but Betty continually 
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reached over for the paints the five-year-old 
was using. The five-year-old protested once in 
a very mild manner and then accepted Betty’s 
behavior apparently not being very concerned 
about it. Finally Betty stopped pushing her 
fingers through the paint, rested her hands in 
the middle of the paper and said, “I wonder 
why I want every jar of paint she has? I 
wonder why? It isn’t the color, because I have 
red, too. And it isn’t because I haven’t got 
any because I have just as much as she has. 
I guess it’s just because she’s got it and I 
wanta take it away from her and I wonder 
why I do that.” She looked straight into the 
therapist’s eyes for a long time. “I never 
thought about why I do what I do before,” she 
added slowly. 

At another time during Betty’s individual 
play therapy session she encountered the limi- 
tations that had been set up by the therapist. 
She fussed and argued and expressed her feel- 
ings quite vividly. The therapist reflected back 
to Betty the emotionalized attitudes that she 
was expressing. Then suddenly Betty stopped 
storming around and said angrily to the thera- 
pist, “You don’t care if I feel mad. You don’t 
care if I feel glad. You don’t care if I don’t 
feel anything I do believe! Allright then! I’ll 
feel all my feelings any old way they are!” 


Jerry, aged seven, had just been in- 
dulging in creating a mess in the play- 
room—spilling water on the floor, throw- 
ing sand around. This was a new ex- 
pression of Jerry’s feelings. When he 
had begun therapy his behavior had 
been rigid, repressed, fearful. Suddenly 
he stopped pouring the water on the floor 
and cried out joyfully, “Oh every child 
just once in their life should have this 
chance to spill themselves out all over 
without a ‘Don’t you dare! Don’t you 
dare! Don’t you dare!’” 

During a contact several weeks later 
he said to the therapist, “It used to be 
I thought everybody was out to get me 
but I guess I been wrong. All people 
aren’t bad people. Some people are good. 
You’re good. Sometimes I’m good. May- 
be—Say, listen—Maybe all people are 
some good and some bad just like me. 
Maybe you are. Maybe even Mom!” 


Harold, eight years old, had been a behavior 


problem. He had spent several weeks in “de- 
structive” play in the play room. On this par- 
ticular day he rushed across the room and 
threatened to break the window—then as sud- 
denly he stopped. “No,” he said to the thera- 
pist. “I don’t have to break that window. I 
don’t have to go on acting like I always have. 
I don’t have to do everything just because I 
get the idea to do it. I don’t have to hit people 
just because I feel like hittin’ ’em. I guess it’s 
because I didn’t know before I could just feel 
mad and in a while it would go away — the 
bein’ mad and 1 would be happy again. I can 
change. I don’t have to stay the same old way 
always because I can be different. Because 
now I can feel my feelings!” 


These brief excerpts are examples of 
the child’s present awareness of his ex- 
periences—are examples of his coming to 
terms with himself. He has stated him- 
self in his play. He has seen himself in 
a different perspective. He seems to be 
developing a different self-concept as a 
result of his experience. This would 
seem to indicate that “insight” is the 
result of a personal experience wherein 
the child sees new meanings in his feel- 
ing reactions. 


Joe, aged eight, suddenly stopped in the 
midst of his play and walked up to the thera- 
pist demanding, “Why do you just say what I 
say and think only what I think? I guess I can 
guess why you do. I’m the little me and you’re 
the big me. I’m all of myselves and you’re all 
of the other people in the world. You’re my 
big shadow that I can make move this way 
and that and I can see just what I am being.” 

Mike, aged seven, cried out in sheer ecstacy, 
“Oh what fun this is to have bought up the 
whole world and owned it all for a whole hour 
on one day every week!” 

Joan, aged five, had veen very timid and shy 
and withdrawn. As the therapy progressed 
she gained courage to be herself and one day 
cried out, “It’s me saying ‘I will!’ It’s me say- 
ing ‘I won’t!’. It’s me saying everything I 
think about and no slaps. Do you know who 
I am?” 

“Who are you?” asked the therapist. 

“I’m a little girl just five years old who can 
stretch up so big I reach clear around my 
world and hug it up in my arms.” (She swept 
out her arms and gathered up the family of 
dolls, the little car, the toy animals — every 
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little toy she could manage to scoop up.) “And 
I can shrink down to be a baby and suck on 
my bottle and crawl around.” (She dropped 
the toys, grabbed the nursing bottle, sucked on 
it and crawled.) “Little and big. Grow and 
shrink. And feel glad inside out!” 


Then there was John, seven years old, 
not knowing how to handle his freedom. 
He stood just inside the playroom door 
and mumbled nervously, “What’ll I do? 
What’ll I do?” He was told that in here 
this hour he could do what he wanted to 
do with the toys and materials—that he 
could play or not play, which ever way 
he felt. But John was not able to make 
a choice and he repeated in a louder 
voice, ““What’ll I do?” Then he yelled at 
the therapist angrily, “Why don’t you 
tell me what to do? Why do you let me 
just stand here? You tell me what to 
do!” 


“So you want me to tell you what to do! 
Well in here, John, it’s up to you to decide 
what you want to do.” 

John screamed at the therapist. 
telling you to tell me what to do!” 

“Yes,” said the therapist. “You want me to 
tell you what to do and I am telling you to 
decide whether you want to stand there or do 
something else.” 

John’s face grew red with anger. “I don’t 
want to just stand here,”he cried. “And I don’t 
want to do something else. I want you to tell 
me (sobs) what—I should—do—” 

“There isn’t anything that you should do in 
here, John. That’s why I don’t tell you what 
to do. Because it doesn’t make any difference 
what you do just so it’s what you want to do.” 

John’s voice dropped to a whisper and he 
said, “I’m afraid.” 

“Are you afraid, John?” the therapist said 
gently. 

“Yes,” John whispered. He came closer to 
the therapist and took her hand. “Mommy al- 
ways tells me what to do,” he said. 

“T see, John. Mommy tells you what to do 
and when someone else tells you to make up 
your own mind, then it scares you?” 

“Yes,” John said. There was a long silence. 
Finally John said, “Would it be all right if I 
played with that little red car?” 

“Yes, if you want to,” the therapist replied. 
John edged over to the little car and began to 


“But I’m 


play with it. 

Five months and twenty-one contacts later 
John spontaneously referred to this first con- 
tact. 


“Do you remember that scared silly little 
kid who was afraid of letting himself do what 
he really wanted to do?” he said to the thera- 
pist. “I can hardly remember that baby. ‘Tell 
me what to do,’” he mimicked. “Scared as a 
rabbit then, that was me. But not any more. 
’Cause now I know what I can do—what I want 
to do—what I will do.” 


These children’s references to the ex- 
periences they were having at the time 
this new self-awareness was emerging 
occurs quite often during therapy. The 
manner in which the children express 
such thoughts—the tone of voice, the 
gleam in their eyes, the spontaneous 
gestures and expressions indicate that 
the play therapy experience is an emo- 
tional experience that brings about re- 
organization of meanings, concepts, 
feelings, self-understanding. It indicates 
that so-called intellectual insight is the 
child’s awareness of these emotional ex- 
periences and that that insight which is 
effective in bringing about such reorgan- 
ization always follows the emotional ex- 
perience of sharpened awareness of the 
nature of his emotional expression. It 
raises the question of the relative posi- 
tion of importance between intellectual 
understanding of cause and effect as de- 
terminants of present behavior and the 
immediate emotional experience the in- 
dividual has during therapy as the es- 
sential dynamic in the process of reor- 
ganization of the self. 

Are these experiences significant to 
the children? How might one determine 
their significance? If we assume that 
significant experiences are those exper- 
iences that change attitudes and behav- 
ior; if we assume that they are remem- 
bered vividly long after the experience 
has passed: then it seems we might be 
able to judge whether or not such ex- 
periences are significant to the child. 
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Changes in attitudes and behavior were 
the criteria upon which the evaluation 
of the therapy as “successful” had been 
made. The attempt was then made to do 
follow-up interviews with some children 
several years after the therapy had been 
completed. The therapist who had con- 
ducted the therapy sessions personally 
did the follow-up studies. She had not 
seen any of the children between the 
termination of therapy and the follow- 
up interviews. Quotations from these 
interviews are presented here for the 
reader’s contemplation. Does it seem to 
have implications for studying the nat- 
ure of emotions, personality structure, 
learning theories, educational practices? 


Tom, whose complete therapy experience 
was reported in Play therapy [1] was inter- 
viewed in his school five years after the termi- 
nation of therapy. Tom was twelve years old 
when the therapist first saw him. He was 
seventeen years old at the time of the follow- 
up. According to school records, Tom was well- 
adjusted and one of the leaders of his class. 
His health was excellent. He was planning on 
entering college after his graduation. He rec- 
ognized the therapist immediately and said, 
“Oh, you’re the puppet-lady!” 

“So you remember me as the puppet-lady, 
do you?” the therapist commented. 

“Yes!” Tom laughed. He sat down across 
the table from the therapist in a small office. 

“Yes,” Tom said. “I don’t think I'll ever 
forget it. It was a real turning point in my 
life—although for the life of me I can’t figure 
out why. It’s been one of the big mysteries in 
my life because—well, I never could under- 
stand why I did what I did or what happened 
to me. But I know one thing. It gave me a 
great deal of satisfaction to make up those 
puppet plays and put them on for those little 
kids. I really enjoyed it. And then one day— 
I remember so plainly—one day right in the 
middle of one of my plays I thought, ‘What 
the heck am I doing here playing with dolls?’ 
Because all of a sudden Ronnie lost all his life. 
Up to that time he was more real than I was 
and J was more like the puppet. And then I 
thought, ‘What the heck! One of me is enough 
in this world and that’s going to be the real me 
and not a doll.’” 

“So you stopped being a puppet and became 
a real person, hm?” 


“Yes, but it was fun. And yet it wasn’t fun. 
Do you know what I mean? I can remember 
it as plain as if it was yesterday. Sometimes 
during those plays I felt really unhappy—and 
I used to go home and—well, I’d think a lot. 
Especially about my stepfather and my sister. 
Incidentally, my sister and I get along fine 
now. I get along all right with Pop, too. Right 
now I’m planning on going to college. I can’t 
quite make up my mind what to major in. I'd 
like to be a doctor—but I can’t decide whether 
to be a human doctor or a horse doctor!” Tom 
laughed. “Then, of course, there is the prob- 
lem of the Army. They may get first choice.” 
And Tom continued talking about his plans 
for the future. 

In this follow-up interview the thera- 
pist did not ask any questions related 
to the therapeutic experience-did not 
initiate any mention of the puppets. 
However, Tom seemingly remembered 
the experience vividly even to the name 
he gave the puppet and recalled it as a 
significant experience in his life. 


A GROUP OF “POOR READERS” FIVE YEARS 
LATER 

Five years ago a group of thirty-sev- 
en children who were nonreaders were 
placed in a class with a teacher-thera- 
pist to experiment with a therapeutic 
approach for poor readers [2]. The 
follow-up study on this group was made 
by the teacher who visited the school 
these children were attending. Out of 
the thirty-seven children in the original 
class, twenty-four were available for 
follow-up studies. Five of these children 
were “honor roll students,” having a 
record of “straight A’s.” Edna, Nancy, 
Ronald, Balcolm and Roger had secured 
that record. In a city-wide scholarship 
test Ronald and Balcolm scored first and 
second place. With the exception of 
Blair, Kenneth, Rollo and Jamey, the 
other children had attained reading skill 
that was adequate for their grade place- 
ment. 

When the therapist visited the class- 
room at a time five years after the ex- 
periment the classroom teacher asked 
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the children if they recognized the visit- 
or. All of the children who had been in 
the remedial class immediately indicat- 
ed that they did. The following conver- 
sation was stenographically recorded. 


Nancy: “I know you. You were the teacher 
who taught us how to read with hammer and 
saws.” 

Balcolm: “I remember the family of dolls 
and our doll house. We had fun.” 

Jack: “I remember one day we buried all 
the mother and father dolls.” (Laughter). 

Ann: “Remember the puppet shows we put 
on? I won’t ever forget that funny show Blair 
put on about the principal!” 

Bill: “I think the music we had then was 
wonderful. I could float way out into space 
on it.” 

Dick: “I remember that year. It was the 
only time in my life I ever felt happy where 
I was.” (He still had a tense voice and a pale 
unhappy face). “I remember we could pound 
and pound and pound.” 

Delores: “The paintings we did with our 
hands.” 

Arlene: “You were good te us. You let us 
do what we wanted to do.” 

Dick: “It didn’t last though.” 

Blair: “Nope. But it was fun while it did 
last.” 

Then the talk veered away from the past ex- 
periences and into the present. 

The therapist then asked each child who 
had been in that class to write the one thing 
they remembered best about that semester. 

The children wrote brief comments. 

Jack—Freedom. 

Leonard—We could play. 

Bill—Everybody was nice to one another. 

Donald—We could do what we wanted to do. 

Jerry—I learned to read. 

* Edna—I found out I could make friends and 
I stopped being afraid of everything. 

Mack—I learned to read. 

Tommy—lI liked to go to school then. 

Allen—We played together and had fun no 
matter what we had to do. 

Ann—The music. 

Delores—To play. 

Roger—So many many interesting things to 
do. 

* Dick—I lost my feeling of being lonesome 
and I felt that I wasn’t all bad and that some 
people liked me and didn’t shove me away. 

Ronald—We were always doing something. 

Blair—We could move without being yelled 


at and do things kids like to do. 
Arlene—I loved the clay and paints and the 
stories. 


* Jim—I remember how I came to feel like I 
was worthwhile. 


Balcolm—I liked the wood-working we could 
do. 

Barbara—We had so much fun. 

Jamey—There were so many things to do. 
Not just lessons. 

Burt—The chance to choose and plan our 
own time. 

Becky—Always something exciting to do. 
* Jenny—I was afraid of everything and 
everybody but I got over being an afraid per- 
son because I wasn’t afraid of anybody in 
there like I used to be. 


All the children seemed to recall their 
experiences in that classroom vividly. 
They remembered for the most part the 
things they did, the activities they en- 
gaged in, the things they learned. How- 
ever, the four children (*) who had had 
individual play therapy sessions after 
school described the experience in terms 
of personal feelings or attitudes toward 
themselves. This is a very brief samp- 
ling, but the discrimination of the ex- 
perience as related by the four children 
who had had individual play therapy 
indicates that the important element to 
them was not the use of the materials 
but an awareness of changing attitudes 
toward the self. 


THE CASE OF SAM 


Sam was twelve when first seen by the 
therapist. The reasons for his referral 
were “failing in school although very 
bright and an excellent academic record 
behind him. Daydreams, sleeps most of 
the time, or reads or goes to the movies. 
Eats continually, wets the bed, has no 
friends, never talks to anyone, just 
briefly, almost rudely answers questions 
and then turns his back on the person. 
Seems very unhappy. Careless about his 
clothes. Always losing things.” 

Three years later at the age of fifteen 
Sam came in for a follow-up interview. 
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“Talking and whittling a piece of wood— 
that’s all I remember doing. Telling you about 
stories I had read, shows I had seen, what I 
had eaten, how I liked eating and sleeping and 
being by myself. Telling you that and all the 
time thinking something else. That here I was 
preferring to keep awake and talk to you— 
to talk about anything at all just to be able 
to come there and talk to you—and saying 
something else to myself all the time. Saying 
to myself that I didn’t really like the way I 
was living away off in a corner of the world 
by myself—burying myself in a book— or in 
a movie—or dreaming—or sleeping. What did 
I do it for then? I asked myself. This time 
I spent talking to you was the most wonderful 
important experience I ever had. Why did it 
seem like that to me? I asked myself. Cer- 
tainly the things I told you weren’t important 
or wonderful. It was a kind of mechanical talk 
that I didn’t even listen to myself. The im- 
portant thing was that J was talking to some- 
one. I was doing it. And I got up early in the 
morning to keep that appointment. I spent two 
hours on the train coming and two hours go- 
ing—five hours all together of real hard effort 
in all kinds of weather and I never missed 
once. Why did I? Because I wanted to get 
away from that dead-alone person I was and 
I wanted to be a together-person in a real 
people’s world.” And the follow-up immedi- 
ately following therapy indicated that he had 
achieved that goal. He made friends, stopped 
going to the movies so often and discontinued 
the excessive reading. He began to diet. He 
went out with his friends to a neighborhood 
Boys Club and started a hobby of leather-tool- 
ing. He stopped wetting the bed. 

Sam maintained these gains. 


THE CASE OF MARYELLEN 


Maryellen was fourteen years old 
when she was seen by the counselor. 
She was referred by a physician who 
questioned the diagnosis of “progressive 
feeble-mindedness” which had been giv- 
en to her by two psychologists and a psy- 
chiatrist. She was a seriously disturbed 
young girl who took no initiative in any- 
thing, had dropped out of school, who 
had no friends, who sat and either 
sulked or giggled, who refused to get 
up in the mornings and who behaved 
in the helpless manner of a very depen- 


dent five-year-old. During her counsel- 
ing contacts she painted with the finger 
paints and gradually dropped the super- 
ficial giggling and meaningless chatter. 
There followed long periods of uninter- 
rupted silences. Finally she began to 
talk to the counselor. After six months 
she was back in school, making friends, 
conversing intelligently with other 
people, adjusting satisfactorily at home 
and at school. When the therapist called 
her to make an appointment for a fol- 
low-up interview, Maryellen said she 
was working after school and couldn’t 
come in but she would write a letter to 
the counselor about her memory of the 
experience. The follow-up was three 
years after the conclusion of therapy. 
Here is a copy of the letter she wrote: 


Dear Friend: 


I remember you because you were the first 
person who ever believed in me—who didn’t 
think I was all bad—who didn’t think I was 
silly—who took the time to try to find out how 
I felt about things. And you never dug into 
me like I was a person without feelings. You 
let we have my own world my own way and 
did not try to snatch it away from me without 
first making me feel strong enough to go live 
in another world or to seek a new world or to 
go without a world for a while until I found 
a new one. It was as though you said to me 
you can hate and you can be sad and you can 
feel cheated by your mother because that was 
the way I felt. And so I didn’t have to lie to 
you or feel ashamed because I was me. I 
painted pictures all the time because then I 
could think in peace. And the quietness was 
around both of us like a clean white shawl 
giving us warmth but not smothering. I 
washed myself clean in that silence. I crept 
back bit by bit into the world of color. It had 
been all black and grey before. I wasn’t being 
sullen when I was quiet with you. I wasn’t 
being hateful that day when I finally said I 
felt hate. I remember saying it deep inside 
myself, with the tips of my fingers scratching 
on the slippery paper. This is hate I feel. It 
had been a numbness but it was not really 
numbness. It was not no-feeling. It was hate 
so big I was afraid of it. But that day I let 
the word creep outside of me that first time 
and it scared me. But it didn’t scare you. I 
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remember it because it struck me like a bolt 
of lightning. I am a hater, I thought. This is 
wicked and bad. Then they separated — the 
feelings and me. I thought you must know I 
have good reasons for my hate even though I 
hadn’t told you then. Another time I men- 
tioned my fear. It was then that I learned 
that a feeling was a changeable thing because 
I felt it change—in my heart, in my arms, in 
my head, in my legs. It came out and twisted 
and turned and lost its sharp edges. From that 
day on I was a free person because I could 
separate my feelings from the people I felt 
about. Then I began to look at myself and try 
and figure myself out. I got so I liked myself 
better. I got so I liked people. I got so I liked 
the world. I think this all happened to me be- 
cause you gave me a chance to believe in me. 
And then I felt I was worthwhile. I have 
grown up since I saw you last. As I think 
back about it you didn’t seem to do a thing 
but be there. And yet a harbor doesn’t do 
anything either, except to stand there quietly 
with arms always outstretched waiting for the 
travellers to come home. I came home to my- 
self through you. 
Your friend, 


Maryellen 


SUMMARIES OF THE CHILDREN’S 
COMMENTS 


Considering the material that has 
been presented in this paper, the follow- 
ing observations, interpretations and 
inferences are presented for the read- 
ers evaluation. 

In each case the child gave evidence 
of remembering the play therapy exper- 
ience vividly and in detail. Also, the 
therapist noted that although she had 
had dozens of child clients during the 
past several years she too remembered as 
vividly as the child and recalled minute 
details of his play activities and expres- 
sions when once again face to face with 
the child. This indicates that there was 
a high degree of concentration and fo- 
cus on the individual child during the 
therapeutic sessions. 

There is also obvious self-reference 
in each case indicating an awareness of 
a changed attitude toward the self. The 


children in recalling the therapeutic ex- 
perience explained it as an experience 
that brought with it sudden awareness 
of what they were feeling and thinking. 

In the excerpts from the original play 
contacts the children’s explanations, 
pulled out of context for illustration, 
present this coming to terms with the 
self in the children’s own words. 

“T never thought about why I do what 
I do, before.” 

“T’ll feel my feelings any old way they 
are.” 

“Oh, every child just once in their 
life should have this chance to spill out 
all over.” 

“T don’t have to stay the same old way 
always because I can be different. Be- 
cause I can feel my feelings.” 

“I’m the little me and you’re the big 
me. I’m all of myselves and you’re all of 
the other people in the world.” 

“Oh, what fun it is to have bought up 
the whole world and owned it all for a 
whole hour on one day every week.” 

“It’s me saying ‘I will.’ It’s me saying 
‘I won't.’ It’s me saying everything I 
think about and no slaps.” 

“Do you remember that scared silly 
little kid who was afraid of letting him- 
self do what he really wanted to do? I 
know now what I can do—what I want 
to do—what I will do—” 

In the follow-up studies the children 
give their perceptions of the experience 
at a later date. There is nothing to indi- 
cate that the children had the insight 
and self-awareness during the therapy 
which they ascribe to it at a date several 
years later. However, the play therapy 
experience was recalled with sufficient 
accuracy in their recital (as was check- 
ed by examination of the records of the 
therapy for confirmation or refutation) 
to justify the conclusion that the later 
interpretations stemmed from the feel- 
ings that the experience created. Per- 
haps the feelings were not clarified by 
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the children at the time they experi- 
enced the therapy. In retrospect, per- 
haps, the rational explanations emerged 
—especially in the cases of Tom, Sam, 
Maryellen, and Dibs. 

The relationship between the experi- 
ence and the children’s interpretation 
of it are more apparent in the follow- 
up interviews. Each quotation is from 
an interview with a different child. 

“And then one day—I remember so 
plainly—one day right in the middle of 
one of my plays I thought, ‘What the 
heck am I doing here playing with 
dolls?’ Because all of a sudden Ronnie 
lost his life. Up to that time he was more 
real than I was and I was more like the 
puppet. And then I thought, ‘What the 
heck! One of me is enough in this world 
and that’s going to be the real me and 
not a doll.’ ” 

“T guess I found out that I could be 
what I wanted to be and how I felt was 
more important than how I looked. I 
couldn’t do that though until I believed 
it myself by the way I felt.” 

“But once I broke loose I could do any- 
thing I wanted to do.” 

“I was afraid to really do anything. 
But it was nice to sit there and think 
maybe I could.” 

“What was it stopped me so I could- 
n’t be a doing-person ?” 

“Maybe I was playing out my war 
with my mom and pop.” 

“T wanted to get away from that 
dead-alone person I was and I wanted 
to be a together person in a real people’s 
world.” 

“It was then that I learned that a 
feeling was a changeable thing because 
I felt it change—in my neart, in my 
arms, in my head, in my legs. It came 
out and twisted and turned and lost its 
sharp edges. From that day on I was a 
free person because I could separate my 
feelings from the people I felt about.” 

“And the feeling I got before I was 


through—a feeling that meant a lot to 
me—a feeling that to you and to me I 
made sense and I was a person worth- 
while.” 

“I built my world there. . .I was afraid 
because I didn’t know what you would 
do. . .I didn’t know what I’d do. But you 
just said, ‘This is all yours, Dibs. Have 
fun! Nobody’s going to hurt you.’ ” 

This verbatim material from the chil- 
dren presents data that could be studied 
and analyzed and interpreted in differ- 
ent ways. It would be interesting and 
helpful to do a similar study interview- 
ing children whose therapeutic experi- 
ences had been of a different type than 
that which had been employed with the 
children in this follow-up study. 

It would also be interesting to do a 
similar study interviewing children 
whose therapeutic experiences had been 
evaluated as failures. 

Certainly every therapist can cite ex- 
amples of “other ways” the play situa- 
tions might have been handled. Perhaps 
the use of different techniques during 
the sessions might have brought forth 
different results. The therapists who 
stress the importance of interpretation 
might think it would have been an im- 
portant addition to the therapeutic ex- 
periences. 

However, instead of focusing atten- 
tion on the “might have beens” there is 
a great need for us to record completely 
and analyze as accurately and objective- 
ly as is possible with our present re- 
search tools, or other tools we might de- 
vise, what actually has happened and by 
comparing the results of all our re- 
search hope to improve our understand- 
ing of the therapeutic process and de- 
vise more effective ways of conducting 
the therapy sessions. 


CONCLUSIONS 


One might conclude that the thera- 
peutic experiences for these children 
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were emotional experiences that sharp- 
ened their awareness of themselves as 
“feeling” individuals — and through 
these “feeling” experiences they gained 
an understanding of themselves, of their 
emotional natures—and with this under- 
standing came a control over their emo- 
tions and feelings. It might be interpret- 
ed as sudden change in self-perception— 
an instantaneous reorganization so that 
Maryellen, and Sam, and Tom, and the 
others not only experienced a change in 
their concept of themselves but were 
aware of the change and could go be- 
yond “thinking what I might do” and 
“do it’—could stop dreaming in a pas- 
sive world and become active in a living 
world—could stop being an unreal per- 
son and live effectively in a realistic 
world—become “real persons in a doing- 
world.” 

If we define adjustment as being free 
to act spontaneously, free to be one’s 
self, “a doing-person,” “a real person,” 
“a together-person in a real world,” a 
person who “can feel their feelings,” 
we might say that these children had 
achieved adjustment by achieving a 
synthesis in self-awareness, self-accept- 
ance, and self-actualization. 

In the cases which were referred to in 
this paper the role of the therapist had 
not been clearly defined to the children. 
This therapist in an attempt to establish 
the kind of relationship with the child 
that stressed noncritical acceptance of 
the child from the beginning of the 
therapy did not explain the situation as 
anything other than a play experience. 
As a matter of fact, this therapist re- 
gards “play therapy” as a play experi- 
ence that is therapeutic because it pro- 
vides a secure relationship between the 
child and the adult so that the child has 
the freedom and room to state himself 
in his own terms exactly as he is at that 
moment in his own way and in his own 
time. Therefore, since the child has had 


no explanation of the therapist’s role he 
is free to interpret it as he will. The 
children’s comments in regard to the 
therapist are interesting. She becomes 
symbolic of “other people in the world,” 
of “the big me,” of “my big shadow 
that I can make move this way and that 
and I can see just what I am being,” of 
“grown-ups,” of “freedom,” of “the 
first person who ever liked me or who 
ever was kind to me,” as “someone to 
talk to,” as “the first person who ever be- 
lieved in me—who didn’t think I was all 
bad—who didn’t think I was silly—who 
took the time to try to find out how I 
felt about things,” as “The Sand Lady,” 
as “the lady of the wonderful playroom 
who said, “This is all for you. Have fun 
. . -Have fun. Nobody’s going to hurt 
you.’ ”’This seems to indicate that these 
therapeutic experiences were immediate, 
active experiences for these children— 
and that it was not necessary for them 
to clarify their “problem” and so to 
work out a logical, rational solution to 
the problem because this was not “prob- 
lem solving” therapy. The case of Sam 
and the case of Martha give some evi- 
dence of this. Sam spent his time during 
the therapy sessions talking as “mechan- 
ically” as he could so that he could ez- 
perience to the fullest the relationship 
with the therapist. Martha did not re- 
call what, if anything, had been discus- 
sed. She was aware only of impressions 
and feelings. And Maryellen’s letter to 
the therapist is a sensitive description 
of an adolescent girl’s emotional awak- 
ening. “And the quietness was around 
both of us like a clean white shaw] giv- 
ing us warmth but not smothering. I 
washed myself clean in that silence. I 
crept back bit by bit into the world of 
color. It had been all black and gray be- 
fore.” 

And so it seems that we might better 
be able to answer some of the questions 
that tease and tantalize so many psy- 
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chiatrists, social workers, psychologists, 
and educators today if we study care- 
fully the objectively recorded interviews 
of many children during therapy and 
in follow-up interviews. For it seems 
that we are not studying material that 
is of interest only to therapists but to 
all those people who are interested in 
learning more about the child—of how 
he thinks and how he feels and how he 
learns. There is an honesty and a frank- 
ness and a vividness in the way children 
state themselves. A consideration of this 
kind of material might add to our stud- 
ies of human behavior and personality 
development that might give to us all 
ways of understanding how feelings can 


“twist and turn and lose their sharp 
edges” and perhaps bring a bit of 
functional psychology to bear upon the 
problems of all interpersonal relations— 
and make a contribution that will en- 
hance the efforts of educators who are 
beginning to think of ways of imple- 
menting theories of building and living 
in a world community. 


Received March 30, 1949. 
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GENERALIZATION IN SUCCESSFUL PSYCHOTHERAPY’ 
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OST contemporary behavior path- 
Mrotoists accept the proposition 
that psychotherapy is a variety of soci- 
al learning. A few have gone further to 
demonstrate, through analogical reason- 
ing, that current theories of learning 
can be applied to the behavioral change 
which constitutes psychotherapy [5, 6, 
10, 11, 12, 13]. The nature of this dem- 
onstration, as well as the extent to which 
it is carried out explicitly, depends in 
part upon the behavior pathologist’s 
preferred level of theoretical descrip- 
tion. It depends also upon the view of 
the treatment process which the therap- 
ist develops through the use of his own 
preferred therapeutic techniques. 

The therapist turned theorist, how- 
ever, is likely to restrict his theoretical 
analysis to the social learning which oc- 
curs during the therapeutic hours. But 
learning which is equally significant oc- 
curs outside the therapist’s office, be- 
tween formal therapeutic sessions. Such 
learning continues, if therapy is success- 
ful, long after formal treatment is over. 
Both therapist and learning theorist 
may then properly ask: “How does suc- 
cessful therapy operate to stimulate 
social learning between sessions?” “Why 
does the patient, after successful thera- 
py is concluded, continue to handle new 
interpersonal situations in ways that 
are socially more mature and valid than 
the ways he developed before?” 


1Based on a paper presented as part of the 
symposium, “Learning and Psychotherapy,” at 
the meetings of the Midwestern Psychological 
Association in Chicago, April 29, 1949. 


GROWTH AS AN EXPLANATORY PRINCIPLE 


Answers to these questions are not al- 
together lacking, of course. One of the 
commonest depends upon a generalized 
principle of “growth.” When in therapy 
the barriers and resistances to normal 
socialization are removed (so runs this 
argument), when the repressed is made 
explicit and anxiety extrojected, the 
patient is “free to grow” toward maturi- 
ty [8, pp. 28-29]. This explanation, how- 
ever, is often applied so loosely as to 
suggest that maturation after therapy 
proceeds automatically. The recovering 
patient is cast in the role of one who 
“just grows.” 


“Growth” in and after therapy, ac- 
cording to this principle, is the conse- 
quence of resolution of fixation. There 
is no denying that habit-fixation may 
alter the course of subsequent social 
learning. Both laboratory experiment 
[9] and therapeutic experience seem io 
indicate that the developmental uneven- 
ness which defines maladaptive behav- 
ior stems from failure to relinquish in- 
appropriate, immature ways of behav- 
ing. It seems doubtful, however, that the 
resolution of fixation alone is sufficient to 
explain the development of more mature 
reactions occurring between the thera- 
peutic hours and after therapy is con- 
cluded. Neither the child who develops 
everyday social behavior nor the pa- 
tient who resumes socialization after 
therapy simply “grows.” Some positive 
learning by child or patient, some posi- 
tive teaching by parent or therapist, 
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whether deliberate or unintentional, 
must occur. 

If the principle of “growth” is overly- 
general for the therapist’s purposes, the 
miniature systems of contemporary 
learning theorists are overly-specific for 
his present state of knowledge. One 
mark of a useful theory is that it is de- 
rived from data of the same general or- 
der as those which the theory later pre- 
dicts. Useful theories of psychotherapy- 
as-social-learning, in other words, are 
those which are derived from controlled 
observations of behavior resembling, at 
least in a general way, what goes on in 
successful therapy. 

At present, the practicing therapist’s 
conceptualization of successful therapy 
is likely to be more molar than molecu- 
lar, more loosely descriptive than rigor- 
ously quantitative. For this reason, the 
therapist today is unprepared to make 
use of many of the strictly defined con- 
structs of stimulus-response learning 
theory. This is not to deny our faith in 
our ability eventually to devise general 
principles which account equally well 
for the learning of rats, monkeys and 
men, and for the learning of eyelid re- 
sponses, nonsense syllables, anxiety and 
self-control. It is to say, however, that 
the therapist needs to look first at his 
own therapeutic situation, and to look 
at it as hard and as systematically as 
the learning theorist looks at the analo- 
gous situations of rat maze and memory 
drum. 

A great many of the phenomena which 
characterize the formal therapeutic hour 
have been given some status within one 
or another theory of learning. The phe- 
nomena which occur outside the formal 
therapeutic hour, on the other hand, 
have received considerably less atten- 
tion. This discrepancy is particularly 
unfortunate from the therapist’s view- 
point, since the criterion of success or 
failure in therapy is defined in terms of 


what happens outside the therapeutic 
hour, in terms of the social validity and 
appropriateness of the patient’s behav- 
ior in his own daily life. This criterion 
is accepted equally by the patient (who 
comes for help because of difficulties in 
his own life) and by the therapist 
(whose goal is the return of his patient 
to a personally satisfying, socially ap- 
propriate role). Stated more generally, 
the learning which occurs in the course 
of a series of therapeutic sessions, and 
which occupies a relatively small pro- 
portion of the patient’s total life, is di- 
rected, in the eyes of both patient and 
therapist, toward another situation. 
Both are concerned primarily with 
changes in behavior which occur out- 
side the limits of the therapeutic rela- 
tionship. Stated still more broadly, the 
learning which constitutes “successful” 
therapy is learning which facilitates 
generalization. 


GENERALIZATION IN SUCCESSFUL 
THERAPY 


To designate roughly the nature of 
this generalization we begin, as the 
therapist begins, with the reactions of 
the patient. At least three aspects of the 
patient’s behavior outside the thera- 
pist’s office indicate to the therapist 
that his patient is improving: (1) 
changed reaction-sensitivities; (2) in- 
creased flexibility of reactions; (3) 
success in handling new interpersonal 
situations. All three must be included in 
any hypothesis of generalization which 
seeks to account for successful therapy. 

(1) Changed reaction-sensitivities. 
Objectively speaking, the patient is in 
the same situation during and after 
therapy as he was before. However, 
these literally identical situations, he 
tells us, now “seem different.” One little 
boy in play therapy, for example, gave 
his therapist an unfailing sign of his at- 
titudes by grading the therapist’s notes. 
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Although he could not read the material, 
the boy was still able (and eager) to 
assign a thirty or a zero to the notes 
when his own anxiety and resistance 
were high, and to assign a grade of 100 
to the notes when therapy had been pro- 
ductive or releasing. As therapy pro- 
gressed, there were increasingly more 
“100’s” and fewer zeros in his assigned 
grades. This is the same sort of sign 
that the environment “seems different” 
which the more sophisticated adult pa- 
tient also gives his therapist. He re- 
ports, often with some surprise and be- 
wilderment, that once impossible de- 
cisions are now made easily, that situa- 
tions in which he formerly developed 
anxiety are now enjoyable, that people 
who formerly irritated or threatened 
him are now friendly. 

These patients are reporting, of 
course, that they are now responding 
differently — and progressively so — to 
the same stimulus-complex. Their reac- 
tions, formerly selective for the nega- 
tive, anxiety-provoking, threatening as- 
pects of the situation, are now differ- 
ently selective. Cameron has called this 
learned selective readiness-to-react to 
some components of a situation and not 
to others, reaction-sensitivity [1, pp. 65- 
68], and the process by which a reaction- 
sensitive person continues to develop 
further readiness-to-react in the same 
direction, progressive reaction-sensiti- 
zation [1, pp. 68-71]. Although his two 
concepts have been employed most fruit- 
fully in explaining the acquisition of 
normal and pathological behavior, they 
apply as well to the social learning 
which goes on during and after therapy. 
The improving patient, we may say, re- 
ports a progressive change in the pat- 
tern of his learned reaction-sensitivities. 

(2) Increased flexibility of behavior. 
The patient characterizes a second facet 
of the generalization underlying success- 
ful psychotherapy when he reports that 


he is trying out new ways of behaving. 
Thus an immature college sophomore 
girl who has had difficulty in accepting 
her adult feminine role reports in ther- 
apy that she has independently pur- 
chased a new suit (“frilly, with a frilly 
blouse’”’), later that she has accepted her 
first date, still later that she has made 
plans for a summer trip to South Amer- 
ica alone. These are all novel responses 
in her previously stereotyped and rigid 
repertory of social behavior. 

Inability to make varied tryouts in 
social problem-solving situations [10], 
the persistence, or fixation, of nonad- 
justive reactions [2], difficulty in shift- 
ing perspectives and sharing a variety 
of social roles [1], and general “rigidi- 
ty” of behavior [7] have all been cited 
as antecedent conditions to the develop- 
ment of behavior pathology. When, 
therefore, the patient reports that he is 
now entering situations which he for- 
merly avoided, and employing tech- 
niques which formerly he did not use, 
the therapist concludes that the patient 
is improving. Increased flexibility of be- 
havior outside the formal therapeutic 
hour is thus a second indicator of thera- 
peutic success, and a second aspect of 
the generalization underlying it. 

(3) Success in handling new situa- 
tions. To these two components of gen- 
eralization in successful therapy the 
therapist must add a third from his own 
observations. As any therapist knows, 
the concrete situations which “seem 
different” to the patient, the novel be- 
havior he tries out, are infrequently 
discussed as such during the formal 
hour. Neither is the so-called “‘present- 
ing symptom” often discussed by patient 
and therapist, although it undergoes 
change and may ultimately disappear 
from the patient’s repertory of behavior. 
If the therapist duplicated in therapy 
every aspect of the patient’s real-life 
situation, then any change in the pa- 


ch hep elie TERED to Ave. 





Gi NERALIZATION IN SUCCESSFUL PSYCHOTHERAPY 67 


tient’s behavior outside the therapeutic 
relationship might be considered the 
consequence of transfer by identical ele- 
ments. This procedure, however, is not 
only impossible but unwise if the pa- 
tient is to handle novel situations suc- 
cessfully after therapy. Like the good 
parent, the good therapist neither can 
nor wishes to create in the therapeutic 
hour miniatures of every situation 
which will confront his patient outside 
the office. But the improving patient 
does confront new interpersonal prob- 
lems outside, and does handle them with 
greater maturity and effectiveness. 
These three aspects of successful 
therapy — changed reaction-sensitivi- 
ties, increased flexibility of behavior, 
and the successful handling of new sit- 
uations—may be fitted, without undue 
distortion, to several contemporary pat- 
terns of learning theory. The field theo- 
rist’s or phenomenologist’s concept of 
perceptual reorganization and differen- 
tiation, with consequent insight, pro- 
vides an attractive analogy, although 
certain of its ahistorical assumptions 
contradict the repetitive, historical nat- 
ure of the therapeutic process [13, 
Chapter 3]. The neo-Pavlovian theo- 
rist’s concept of stimulus- generalization 
is equally plausible, although the task 
of identifying, on a scale of jnd’s, 
stimuli which are more or less similar 
to those occurring in the therapeutic 
hour is a difficult one [4]. A third possi- 
bility, which allows for a principle of 
repetition or reinforcement, but which 
deals with the sort of molar variable 
which the contemporary therapist must 
employ, is provided by Harlow’s concept 
of the formation of learning sets [3]. 


GENERALIZATION IN PSYCHOTHERAPY AS 
THE FORMATION OF A LEARNING SET 


It is ordinarily agreed that the patient 
reacts to the therapist in terms of his 
reactions to other persons: the patient 


in his own reactions casts the therapist 
in the roles of father, mother, wife, em- 
ployer or child. He generalizes his re- 
actions from his everyday life to the 
therapist. It would probably also be 
agreed that the patient, in and after 
therapy, reacts to persons outside the 
office in terms of his learned reactions 
to the therapist: he now responds to his 
father, mother, wife, employer or child 
as he has responded to the therapist cast 
in these roles in therapy. This two-way 
reaction of the patient to the therapist 
and in terms of the therapist suggests 
an hypothesis for the generalization 
constituting “successful” therapy. 

The simplest statement of this hy- 
pothesis is that the patient learns in the 
therapeutic hour to know and to react 
to the therapist as a person [6], and 
carries over these reactions to others 
outside. It would be more accurate, how- 
ever, to say that he learns to know many 
persons, none of whom is actually the 
therapist, but each of whom is an organ- 
ization of behavior—a role or a person 
—projected upon the therapist. What the 
patient learns, then, is not to know one 
person, the therapist. Nor does he learn 
a repertory of specific reactions which 
he then employs in identical situations 
outside the therapeutic hour. He learns 
how to learn a certain variety of prob- 
lem—that of handling interpersonal] sit- 
uations which the therapist’s presence 
enables him to structure. That he has 
developed a generalized ability to handle 
problems is demonstrated in his chang- 
ed reaction-sensitivities, his new ap- 
proaches to old situations, and his suc- 
cessful handling of new problems in his 
everyday life—the criteria of successful 
therapy. The same criteria attest to the 
formation of what Harlow has called a 
learning set. 


The experimental background of the 
concept of learning set is in the respon- 
ses of monkeys and preschool children 
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in a series of discrimination problems. 
When problems rather than trials are 
employed as measures of performance, 
it can be shown that the subject becomes 
increasingly efficient at solving prob- 
lems, even though the stimulus-objects 
in each succeeding discrimination are 
novel for him. “The data indicate,” says 
Harlow, “that the subjects progressive- 
ly improve in their ability to learn ob- 
ject-quality discrimination problems. 
The monkeys learn how to learn individ- 
ual problems with a minimum of errors. 
It is this learning how to learn a kind 
of problem that we designate by the 
term learning set.” [3, pp. 52-53] 

Of the many implications of the con- 
cept of learning sets for the acquisition 
of personal-social behavior—and conse- 
quently for successful psychotherapy— 
there are three which provide close ana- 
logies to the three aspects of generaliza- 
tion in psychotherapy mentioned earli- 
er: 
(1) “....a learning set once formed 
determines in large part the nature and 
direction of stimulus-generalization.” 
[3, p. 64] On the basis of this theory, a 
conditioned fear response, for example, 
generalizes in a selective way, depend- 
ing upon the learning set. An affectional 
learning set in relation to people, to 
borrow Harlow’s example, inhibited the 
development and generalizations of Al- 
bert’s fear to the experimenter as well 
as to the rat in Watson’s classic experi- 
ment on conditioned fear. 

In an analogous way, to the patient 
who has learned how to learn problems 
of interpersonal relationships, the situ- 
ation now “looks different.” His own re- 
actions, now selective on the basis of a 
learning set, define the situation differ- 
ently, and invite different reciprocal 
attitudes and responses from others. 
His learning set, developed in the formal 
therapeutic hours, determines for him 
the direction of stimulus-generalization 


in the problems which confront him in 
everyday life. The phenomenon of 
changed reaction-sensitivity, our first 
criterion of successful psychotherapy, 
can thus be considered as one conse- 
quence of the formation of a learning 
set. 

(2) “Training on several hundred 
specific problems has not turned the 
monkey into an automaton exhibiting 
forced, stereotyped, reflex responses to 
specific stimuli. These several hundred 
habits have, instead, made the monkey 
an adjustable creature with an increas- 
ed capacity to adapt to the ever-chang- 
ing demands of a psychological labora- 
tory environment.” [3, p. 59] The gen- 
eralization involved in learning sets, in 
other words, is not a transfer of single 
responses from one situation to another. 
Learning sets make for greater adapta- 
bility and flexibility of behavior in the 
monkey. The same adaptability charac- 
terizes the improving patient, who tries 
out new situations and new ways of be- 
having. In learning how to learn inter- 
personal problems, the patient also be- 
comes increasingly adaptable and flex- 
ible. Our second criterion of successful 
therapy, increased flexibility of behav- 
ior, can also be considered a consequence 
of the formation of a learning set. 

(3) “Before the formation of a dis- 
crimination learning set, a single train- 
ing trial produces negligible gain; after 
the formation of a discrimination learn- 
ing set, a single training trial consti- 
tutes problem solution. These data clear- 
ly show that animals can gradually 
learn insight.” [3, p. 56] The monkey 
who has learned how to learn a discrim- 
ination problem, according to these data, 
begins his next (new) problem at a 
higher level of performance and masters 
it with greater efficiency. Improvement 
from problem to problem continues un- 
til one-trial problem solution occurs. 

Informal observation of the social be- 
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havior of the monkey toward human 
beings supports the description of a 
systematic learning process derived 
from the discrimination experiments. 
Harlow suggests, “Each contact the 
monkey has with a human being repre- 
sents a single specific learning trial. 
Each person represents a separate prob- 
lem. Learning to react favorably to one 
person is followed by learning favor- 
able reactions more rapidly to the next 
person to whom the monkey is socially 
introduced .... eventually the monkey’s 
favorable reactions to new people are 
acquired so rapidly as to appear almost 
instantaneous.” [3, p. 64] 

In an analogous way, the patient who 
has learned how to learn interpersonal 
reactions at the hands of his therapist 
is bound to begin in his first new inter- 
personal problem outside the therapeutic 
relationship at a higher level. We would 
expect, from this same principle, that 
his succeeding interpersonal contacts 
would be increasingly more effectual. 
Our third criterion of effective therapy, 
success in handling new interpersonal 
situations, can thus also be considered 
the consequence of the formation of 
a learning set. 


SUM MARY 


“Successful” therapy eventuates in 
changed reaction-sensitivities, increased 
flexibility of behavior, and success in 
handling new interpersonal problems, 
occurring outside as well as within the 
formal therapeutic sessions. These three 
aspects of successful therapy imply the 
occurrence of generalization from the 
formal therapeutic hour to outside, 
everyday situations. The nature of this 
generalization is such as would be pre- 
dicted if the patient had acquired, in 
the therapeutic relationship, a learning 
set. Consequently, it is suggested that 
the improving patient is the patient who 
has learned how to learn a certain vari- 


ety of interpersonal problem in the 
presence of his therapist. 

The hypothesis of learning set, while 
more restricted than a generalized 
growth principle, is also more definitive. 
Therapy is not formulated merely as 
“freedom to grow.” The hypothesis has 
the further advantage of using molar 
variables rather than the molecular 
variables which many current stimulus- 
response theories of learning employ. 
The patient is not depicted as having 
acquired a repertory of specific reac- 
tions which generalize from therapeutic 
hour to equivalent stimuli outside. What 
he has acquired is a generalized method 
of learning. It is this method which per- 
mits him, between therapeutic sessions 
and long after therapy is concluded, to 
continue with his delayed task of social- 
ization. 


Received June 15, 1949. 
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AN ADMINISTRATION BOARD FOR THE WECHSLER- 
BELLEVUE OBJECT ASSEMBLY SUBTEST 


GORDON F. DERNER AND MURRAY ABORN 


TEACHERS COLLEGE, COLUMBIA UNIVERSITY 


HE Object Assembly subtest of the 
Wechsler-Bellevue intelligence 
scale [2] is one of the most difficult for 
the clinician to manipulate during pre- 
sentation. First, it requires the placing 
of several small pieces in prescribed ar- 
rangements. The actual order for pre- 
sentation is illustrated in the test man- 
ual [2,pp. 181-182] and must be follow- 
ed in standardized administration. Sec- 
ond, since the later reprintings of the 
third edition of this manual, the word 
“beforehand” has been inserted in the 
directions for laying out the pieces. It is 
therefore essential that the pieces be 
laid out not only in the prescribed con- 
figuration but also in a fashion that en- 
ables the subject to begin work immedi- 
ately upon presentation. 

Several techniques for complying 
with standardized test procedure have 
been devised by practitioners but none 
are completely satisfactory. It is possi- 
ble for the clinician to place the pieces 
for each item on boards in the prescrib- 
ed order, keeping them covered until the 
time of administration. The difficulty 
with this technique is that the pieces 
are apt to shift their position in the 
handling of the boards so that they will 
not be properly arranged upon present- 
ation. Most clinicians proceed to arrange 
the pieces on the examination table im- 
mediately before the presentation of 
each subtest item. Because of the diffi- 
culty inherent in the placing of irregular 
shaped pieces at various angles to each 
other, presentation often varies from 
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the prescribed order. Some clinicians 
have attempted to solve this by the use 
of a template [1]. In situations where 
placement is made during the actual 
test administration, moreover, some 
technique to prevent the subject from 
seeing the materials while they are be- 
ing prepared is necessary. The subject 
may be told to turn his head, or a shield 
may be placed between the subject and 
the testing materials. Any technique, 
however, which asks the subject to re- 
move himself psychologically from the 
situation, even while materials are be- 
ing arranged, is not to be recommended. 
A technique to eliminate the possible 
loss of rapport in such a situation is de- 
sirable. The various difficulties in the 
administration of the Object Assembly 
subtest call for the development of a 
technique which can meet standardized 
test demands with simplicity of presen- 
tation. 


Over the past year the authors have 
developed an Administration Board 
which is adaptable both to Form I and 
Form II of the Wechsler-Bellevue Ob- 
ject Assembly subtest. The method in- 
volves the use of an apparatus contain- 
ing a stencil with insets for the pieces 
of a subtest item. The insets are cut so 
that the pieces are placed in an upside- 
down, mirror-reversed order of the 
standardized arrangement. There is an 
easily removable cover which holds the 
pieces in place and at the same time con- 
ceals the material. In use, the Adminis- 
tration Board is turned upside down on 
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the examination table. The cover is then 
removed mechanically, allowing the 
pieces to fall on the table right side up 
in the standardized arrangement. Thus 
administration is facilitated and stand- 
ardized presentation is assured. The 
appearance of the Board might be com- 
pared with a flush model of the Seguin 
formboard with covers over it to pre- 
vent the insets from falling out when 
turned over. 

The Object Assembly subtest can be 
arranged in a very compact form. For 
Form I, the stencil on one side of the 
Board contains the Manikin item and 
Hand item as separate halves of the 
Board, and on the reverse side is the 
stencil for the Profile. In this way, the 
three items of the Object Assembly sub- 
test are available for ready administra- 
tion in a single piece of apparatus. Af- 
ter administration, the pieces can be put 
in their proper insets in the stencils and 
the covers replaced. The subtest items 
thus may be conveniently stored and are 


always ready for prompt administra- 
tion. 


SUMMARY 


In order to better standardize and fa- 
cilitate the administration of the Object 
Assembly subtest of the Wechsler-Belle- 
vue intelligence scale, an Administra- 
tion Board has been developed. This 

3oard provides for prompt presentation 
of these subtest items in accordance 
with the instructions for laying out the 
material. Second, it always presents the 
material with the standardized location 
of pieces. Third, it serves as a satisfac- 
tory kit for keeping material in compact 
form and always ready for administra- 
tion. 

Received March 24, 1949. 
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ANASTASI, ANNE AND FOLEY, JOHN P., JR. 
Differential psychology. (Rev. ed.) New 
York: Macmillan, 1949. Pp. xv+894. $5.50. 


This is a thorough revision and considerable 
enlargement of the 1937 edition. The four new 
chapters cover basic concepts of psychological 
testing, biological and psychological factors in 
simple behavior development and the effect of 
schooling on intelligence. The volume repre- 
sents the same kind of excellent critical cover- 
age of the literature presented in a clear sys- 
tematic manner as was found in the original 
text. Hundreds of studies are presented in a 
manner to emphasize their methodological and 
theoretical background. The orientation of the 
subject matter is in terms of genetics, anthro- 
pology and sociology as well as psychology. It 
is more than a presentation of differential 
psychology but is in fact “one approach to the 
understanding of behavior.” Investigators who 
tend to see constitutional implications in their 
studies will be impressed with the cultural in- 
terpretation that these authors have advanced. 
—F. McK. 


CARTER, HOMER L. J. AND MCGINNIS, DoROTHY 
J. Reading manual and workbook. New 
York: Prentice-Hall, 1949. Pp. vii + 120. 
$2.35. 


A diagnostic and remedial guide for the im- 
provement of the reading of college students. 
The manual consists of a series of 22 assign- 
ments of which 4 are designed for measure- 
ment, and 18 for the improvement of reading 
and study skills. In addition to reading tests, 
a self-scored “orientation inventory” question- 
naire is used to aid the location of physical, 
emotional, and educational factors relevant to 





NOTE: Some reviews in this issue were pre- 
pared by the Associate Editors, who may be 
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the disability. The remedial exercises are ex- 
plicit and practical, and can be used with a 
minimum of supervision. 


CHAPANIS, ALPHONSE, GARNER, WENDELL R., 
AND MorGAN, Ciirrorp T. Applied experi- 
mental psychology. New York: Wiley, 1949. 
Pp. xi+434. $4.50. 


The war and postwar years saw a rapid 
development of the psychology of man and his 
machines. This book brings together for the 
first time the essentials of method in human 
engineering and the findings so far produced 
by research in the area. Introductory chap- 
ters define the field, and give some background 
in relatively simple statistics. The remainder 
of the book is organized around three foci, 
with chapters on how we see, hear, and make 
movements, followed, respectively, by applied 
problems involving vision, audition and mo- 
tion. The style of the textbook is notable. 
While dealing with complex subject matter, 
it maintains a consistent air of simplicity and 
clarity. As a result, it will be useful for a 
wide range of audiences, not only as a hand- 
book for the worker in applied psychology, 
but for the psychologist who knows only a 
little engineering and the engineer who knows 
only a little psychology. 


CRONBACH, LEE J. Essentials of psychological 
testing. New York: Harper, 1949. Pp. ix + 
475. $4.50. 


A helpful exposition of some of the major 
principles involved in the construction, stand- 
ardization, selective use, and evaluation of re- 
sults in the overall] field of assessing the ca- 
pacities, achievements and related aspects of 
human “processing” by individual and group 
procedures. The emphasis is toward eclectic 
topical orientation of issues and representa- 
tive techniques. — E. A. D. 


FRANK, JEROME Courts on trial. Princeton, N. 
J.: Princeton Univ. Press, 1949. Pp. xii + 
441. $5.00. 
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Subtitled Myth and reality in American 
justice, Judge Frank’s book probes the real 
operation of the judicial system in contrast to 
orthodox stereotypes about it. All of the vol- 
ume will interest psychologists as citizens; 
parts of it relate directly to professional con- 
cerns. There is rich material on reasoning 
processes, on convincing and deceiving people, 
and on the personalities of litigants, lawyers 
and judges. 


FREupD, ANNA et al. (Eds.) The psychoanalytic 
study of the child. New York: International 
Universities Press, 1949. Pp. 493. $10.00. 


The Psychoanalytic Study of the Child is a 
collection of twenty-five loosely related papers, 
bound physically between two covers, but 
otherwise not connected by introduction, com- 
ment, or other means. The variability in pre- 
sentation and in usefulness could hardly be 
greater; the range is from pure gibberish to 
inspired contribution. The best and the worst 
in Freudian psychology is represented in this 
volume, and if one takes the trouble to plow 
through the tremendously overelaborated verb- 
iage, one will find a number of extremely im- 
portant contributions to dynamic psychology. 
In this review, some of the worthwhile as- 
pects are listed. 


A report of a study of three sets of infant 
twins over several years, by Dorothy Burling- 
ham (London), is a model of clinical obser- 
vation of personality development in young 
children. Another study of autoerotic behav- 
ior in 170 children in the first year of life by 
Rene Spitz, is much more elaborate and very 
carefully controlled. Some of the conclusions 
of this study are surprising, and contrary to 
popular concept: the major one is that auto- 
erotic behavior in the infant is practically non- 
existent when the mother-child relationship is 
poor, and is common when the relationship is 
good. Another unexpected finding is contained 
in Kate Friedlander’s report on “Neurosis and 
home background,” in which she states that 
in 27 out of 33 neurotic children (82 per cent) 
neurosis could not have been predicted from 
home factors. On the other hand, 32 out of 34 
antisocial children had severe social pathology 
in their homes. 

August Aichhorn (Vienna), in his usual pro- 
found approach, studied a sampling of 250 de- 
linquent girls and, after describing five major 
psychological types into which these girls can 
be classified, outlined the type of environment 
each group requires for successful treatment. 


Also worth reading are Louise Despert’s 
“Dreams in children of preschool age”; Mar- 
garet S. Mahler’s “A psychoanalytic evalua- 
tion of tic in psychopathology of children”; 
and Bergman and Escalona’s “Unusual sensi- 
tivities in very young children.” 

Emanuel Klein follows his now classical 
“The reluctance to go to school,” which appear- 
edin Volume I of the same publication (1945), 
and which was one of the first satisfactory 
treatments of school phobias, with another 
excellent treatment in “Psychoanalytic aspects 
of school problems.” 


As is usual in psychoanalytic works, a num- 
ber of elaborate discussions of analytical cases 
are included. For those interested in the anal- 
ysis of young children, Berta Bornstein’s “The 
analysis of a phobic child” is highly recom- 
mended for clarity of presentation, for a dis- 
cussion of “some problems of theory and tech- 
nique in child analysis,” and for the type of 
recording which social workers call “process 
recording.” 

There is much more in this volume—good, 
bad, and indifferent. Others will undoubtedly 
disagree with the reviewer’s selection of arti- 
cles. There is enough material and enough 
variety in this publication to warrant the in- 
terest of any psychologist. — M. K. 


GESELL, ARNOLD, ILG, FRANCEs L., AND BULLIS, 
GLENNA E. Vision: Its development in in- 
fant and child. New York: Paul B. Hoeber, 
1949, Pp. xvi + 329. $6.50 


A detailed study of the development of 
vision in infancy and childhood, and of the re- 
lationships of vision to the total pattern of 
growth. The book serves a number of needs. 
For the teacher, parent or lay reader, its read- 
able style and many attractive illustrations 
give lively and readable account of the develop- 
ment of man’s most fascinating sense. For spe- 
cialists in medical and psychological fields, 
there are norms for visual development, with 
detailed instructions for visual examinations 
from early infancy to the age of ten years. 


HILLPERN, ELSE P., HILLPERN, EDMUND P., 
AND SPAULDING, IRVING A. Bristow Rogers, 
American Negro. New York: Hermitage 
House, 1949. Pp. 184. $3.00. 


This unusual psychoanalytic study consists 
mainly of the written free associations and 
dreams of a sensitive, intelligent Negro, as he 
struggles with his problems of status, occupa- 
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tion, and sex. The analyst provides interpreta- 
tions and summaries. 


Hoppock, ROBERT Group guidance: principles, 
techniques and evaluation. New York: Mc- 
Graw-Hill, 1949. Pp. xiv + 393. $3.75. 


A practical text for teachers and counselors 
who have responsibility for guidance, with em- 
phasis on the high school level. The first sec- 
tion outlines the aims, organization and con- 
tent of group guidance, and a second part des- 
cribes a variety of techniques very concretely. 
A chapter on evaluation summarizes twenty 
research studies on the outcomes of guidance 
practices. Twenty-two appendices covering 149 
pages supply practical illustrations and ma- 
terials. The book will be a ready help to the 
many school people who face limited but im- 
portant demands for guidance with little pre- 
paration. 


LANE, Homer. Talks to parents and teachers. 
New York: Hermitage Press, 1949. Pp. 217. 


2.75. 


Homer Lane died almost a quarter century 
ago, after a pioneer and little-appreciated 
career in introducing tolerant methods for the 
rehabilitation of delinquent children both in 
this country and in Great Britain. His hitherto 
unpublished essays brought together in this 
small book include chapters on the stages of 
child development, on parent-child relation- 
ships, and on “the self-determination of small 
people.” While not in every detail in accord 
with today’s theories, the essays interestingly 
forecast current ideas concerning the role of 
the self-concept in behavior, and of permissive- 
ness in therapy. 


LAWRENCE, MERLE Studies in human behavior. 
Princeton, N. J.: Princeton Univ. Press, 
1949. Pp. x + 184. $3.50. 


This is a well written, well organized, and 
up to date laboratory manual for use in gen- 
eral psychology courses. Its purpose is to 
stress the basic principles of individual and 
group behavior with an emphasis on percep- 
tion. The only difficulty is one mentioned by 
the author in his preface, the required equip- 
ment is somewhat elaborate and expensive. — 
W. A. H. 


MOLONEY, JAMEs C. The magic cloak. Wake- 
field, Mass.: The Montrose Press, 1949. Pp. 
xxiii + 345. $5.00. 

A series of essays about patients, analysts, 


and other people, with the central theme of 
the origin and effects of the pathological need 
for authority. Patient and analyst alike wear 
the “magic cloak” of authoritative omnipotence, 
by which they protect themselves from a fear 
of helplessness. The need for this inconveni- 
ent garment arises from the separation anxiety 
of the infant whose mother is demanding and 
coercive instead of supportive. The author 
does not support Freud’s view of the oedipus 
and castration complexes, and has a chapter, 
“beyond the sexual principle.” His provocative 
book will stimulate those interested in person- 
ality and psychotherapy. 


MOSTELLER, FREDERICK et al. The pre-election 
polls of 1948. Bulletin 60. New York: Social 
Science Research Council, 1949. Pp. xx + 
396. Paper $2.50, cloth $3.00. 


After the spectacular failure of the polls to 
predict the outcome of the 1948 election, a 
committee of the Social Science Research 
Council made a critical study that was report- 
ed in December 1948. The Bulletin gives a full 
report of the staff studies underlying the com- 
mittee’s findings, including details on sampling, 
interviewing, adjustment of data, and public 
presentation of results. It is of general value 
as a methodological study, apart from the di- 
rect interest in the issue of election forecasting. 


O’KELLY, LAWRENCE I. Introduction to psycho- 
pathology. New York: Prentice-Hall, 1949. 
Pp. xxi + 736. $4.50. 


Long a familiar term in medica] education, 
psychopathology is offered as a more appropri- 
ate title for the study of maladjustive behavior, 
in place of the outworn “abnormal psychology.” 
O’Kelly’s text is divided into three parts, an 
introduction that includes a chapter on basic 
concepts, a section on the problems (syn- 
dromes) of disordered behavior, and one on 
the causes: genetic, organic, behavioral, and 
social. There is a brief chapter on treatment 
and prevention. The varied background of the 
author is evident in the book. The unusually 
able handling of physiological issues, and the 
frequent citation of animal experiments, reflect 
his training in comparative psychology. The 
many new case descriptions are drawn in the 
main from his experience as a clinical psy- 
chologist in the Army. The chapter on anxiety 
is especially able. Many psychologists will rec- 
ognize a few shortcomings: adjustment and 
adaptation are used as synonyms, frustration 
and conflict are often inadequately differentiat- 
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ed, the ten pages on psychotherapy are too 
sketchy for such a key topic. The assets of the 
text, however, clearly outweigh its minor lia- 
bilities. The clear style and systematic plan 
commend it as a teaching aid. It has enough 
newness to be distinctive, but no eccentricities 
to hinder its usefulness to instructors and 
students as a sound basic text. 


Sopen, WiLuiAM H. (Ed.) Rehabilitation of 
the handicapped. New York: Ronald, 1949. 
Pp. xiii + 399. $5.00. 


This book is a compilation of the most re- 
cent thinking and research in the field of re- 
habilitation of the handicapped. There are 
some forty-four well selected contributors. 
There has been a definite attempt to bring con- 
tributions from those who know the various 
technical aspects of the problem and whose 
articles would not be readily available to their 
co-workers. The papers are uniformly well 
written and many contain lists of reference for 
further study. Rehabilitation of the handicap- 
ped has many ramifications. The articles are 
distributed over a wide area. The medical, psy- 
chological, and sociological aspects are dealt 
with authoritatively. There is an excellent in- 
dex. The volume is well planned and should 
prove very helpful to anyone who has to meet 
any phase of the rehabilitation of the handi- 
capped. — B. M. L. 


VAUGHAN, ELIZABETH HEAD Community under 
stress. Princeton, N. J.: Princeton Univ. 
Press, 1949. Pp. xv + 160. $2.50. 


In a small Japanese concentration camp in 
the Philippines, Mrs. Vaughan was “an involun- 
tary participant observer” of the evolution and 
adjustments of a micro-society of mixed nation- 
al and racial origins. Her sensitive but objec- 
tive account traces the development of the 
camp’s social organization, and the relation- 
ships between the prewar cultural patterns of 
individuals and their adaptations to the role of 
prisoner. 


WALLIN, J. E. WALLACE Children with mental 
and physical handicaps. New York: Prentice- 
Hall, 1949. Pp. xxii + 549. $6.65. 

A revision and extension of the author’s 
classic Education of handicapped children, 
thie volume is a product both of forty years of 
direct personal experience and of painstaking 
survey of the research literature. Recent stud- 
ies, such as the Iowa and Chicago reports of 
raising IQ’s by special education, are reported 
fully and reviewed critically. Accounts of en- 


docrine disorders are especially complete, as 
also are those of neurological conditions, in- 
cluding encephalitis, cerebral palsy and polio- 
myelitis, that have evoked psychological in- 
terest. The book is well illustrated, both by 
photographs and case descriptions, and will be 
a helpful resource for clinical psychologists in 
practice and in training. 


Wever, ERNEsT G. Theory of hearing. New 
York: Wiley, 1949. Pp. xiii +484. $6.00. 


A survey of theories of hearing, with the 
evidences, implications and shortcomings of the 
various viewpoints. A first part traces the earli- 
er classical theories, and a second is devoted to 
the place and frequency theories as developed 
in recent times. In the third and largest part 
of the book, the author presents his “volley 
theory,” which integrates and reconciles the 
previously held accounts. While intended main- 
ly for experimentalists, the book has values 
for clinical psychologists. Clinical evidence 
about auditory function is considered, as well 
as laboratory studies. There are clear and use- 
ful descriptions of auditory abnormalities, in- 
cluding tinnitus, diplacusis and deafness. The 
anatomical illustrations are unusually excel- 
lent. 


WOLLNER, MARY HAYDEN BOWEN Children’s 
voluntary reading as an expression of indi- 
viduality. Teach. Coll. Contr. Educ. No. 944. 
New York: Bureau of Publications, Teachers 
Coll., Columbia Univ., 1949. Pp. viii + 117. 


$2.35. 


A case study approach to the voluntary 
reading of children 12 to 14 years old revealed 
the weakness of often accepted generalizations 
about the relations of reading to intelligence, 
sex, social environment, and emotional adjust- 
ment. Each child’s voluntary reading could be 
understood only in terms of his unique con- 
stellation of dynamic characteristics. 


Children absent from school. New York: Citi- 
zens’ Committee on Children of New York 
City, 136 E. 57 St., 1949. Pp. 116. $1.00. 


An able and sympathetic study of the social 
and psychological problems of truancy. Al- 
though the data pertain to New York, many of 
the conclusions and recommendations for action 
are more widely applicable. A broad program 
for child guidance is outlined, centering on 
the classroom teacher. 
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TESTS 


BENNETT, GEORGE K., SEASHORE, HAROLD G., 
AND WESMAN. ALEXANDER G. Validation of 
the Differential Aptitude Tests. First re- 
search report, Sept., 1948, pp. 9, and second 
research report, Feb., 1949, pp. 9. Distribu- 
ted as supplements to the Manual issued in 
1947. New York: Psychological Corp., 1948, 
1949. 


In 1947, the authors promised that validation 
data for this battery of guidance tests were be- 
ing collected and analyzed. These two supple- 
ments present about 700 coefficients of corre- 
lation between grades in school subjects and 
the eight subtests of the battery. The criterion 
scores are grades earned one or two semesters 
after the tests were given. Seven school sys- 
tems are included. The supplements have 
been distributed to holders of registered copies 
of the Manual, and are included in Manuals 
sold subsequent to their issue. 


VERNON, P. E. Graded arithmetic—mathemat- 
ics test. Ages 7-15. 1 form. 20 (25) min. Test 
blank (4 d. ea., 1/2/11 per 100 incl. tax); 
manual, pp. 12 (9 d.). London Eng.: Univ. 
of London Press, 1949. 


This brief British test will not have direct 
use in America because of problems involving 
a different monetary system, but it has fea- 
tures that might well be imitated. Intended 
primarily for rapid measurement in child 
guidance clinics rather than for general school 
use, the test covers an exceptionally wide range. 
It.is standardized against mental age, and con- 
sists of 15 blocks of five items, each repre- 
senting one year level. Administration resem- 
bles that of the Stanford-Binet, beginning with 
a block at which a child is likely to pass all 
items, and continuing upward until none are 
passed. Reliability and standardization data 
are capably reported. 
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THE PRESENT STATUS 
OF 


PSYCHOTHERAPEU TIC 
COUNSELING 


BY 
WILLIAM U. SNYDER 


This popular review is the 


July, 1947 issue of the Psy- 


chological Bulletin 
Pp. 90 $1.25 


AMERICAN PsyYCHOLOGICAL ASSOCIATION 
1515 MassacHusetts AVENUE, N. W. 
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1949 DIRECTORY 
AMERICAN PSYCHOLOGICAL ASSOCIATION 


1515 MASSACHUSETTS AVENUE N. W. 
WASHINGTON 5, D.C. 


In the alpnabetical list of 6785 members, the 1949 Directory of the Asso- 
ciation gives the names of the members, their addresses, their present po- 
sitions, their last degrees, and their class of membership. Membership 
lists for the Divisions of the Association, the lists of Diplomates in the 
fields of clinical, industrial, and counseling of the American Board of 
Examiners in Professional Psychology, the By-Laws, and a geographical 
and institutional index of members are included, The editor is Helen M. 
Wolfle of the Association Staff. 250 pages, $2.00. 
























For the rapidly growing interest among psychologists in problems of 
social perception we present the supplement to the September issue of 
The American Journal of Sociology: 


MISUNDERSTANDINGS 
IN HUMAN RELATIONS 


A Study in False Social Perception 
by GUSTAV ICHHEISER 


In this document Dr. Ichheiser uses the method of phenomenology in 
analyzing the mechanisms which distort social perceptions and bring 
coniusion in human relations. 


Copies of the monograph may be ordered at $1.25. Orders and inquiries 
about quantity discounts should be addressed to: 


THE AMERICAN JOURNAL OF SOCIOLOGY 
UNIVERSITY OF CHICAGO PRESS 
5750 Ellis Avenue Chicago 37, Hlinois 






































New McGRAW- HILL Books 





EXPERIMENTS IN SOCIAL PROCESS 
chology 
By James G. Muir, The University of Chicag 
gy. In press. 


Contains articles by outstanding experts describ: 


chology and demonstrating how they can be a) 


terpersonal behavior. The final chapter is an wu: 


tists and a nuclear physicist which deals with t 
to the atomic bomb. 


\ Symposium on Social Psy- 


Jraw-Hill Publications in Peycholo- 


r new techniques in social psy- 
ed to learn new facts about in- 


isual discussion by social scien- 


practical approach of scientists 


CHILD DEVELOPMENT. New 2nd edition 


By E.imzaberH B. Hurwoce, The University of | 
im Psychology. In press 


A thorough revision and modernization of a well 


sults of experimental studies of children from b 
been brought up to date and three new chapters 
have been coordinated to give the reader a pict 
ferent phases of his development. Common be! 
emphasis on their causes and the best methods « 


FUNDAMENTAL STATISTICS IN PS 
TION. New 2nd edition 
By J. P. Guttrorp, Professor of Psychology. U 
Hill Publications in Psychology. In press 
An elementary yet comprehensive coverage of 
statistical methods and the newer procedures | 
Introduces the reader to routine procedures, st: 
results, and includes enough of the applications 


book for the average investigator in the social a1 


PERSONALITY. A Systematic Theoreti: 
By Raymonp B. Catret., University of Llinois 
In press 
Places the study of personality on a more exa: 
The text begins with recent advances in theory 
the description and measurement of personality 
interaction of heredity and environment, the 
about the dynamic processes of adjustment an 
ology and anthropology is integrated; physiolo; 
are discussed; finally, these contributions are 
stages of personality. 


Send for copies On app 


sylvania. McGraw-Hill Publications 


own text which presents the re- 
h to maturity. The material has 


ave been added. The materials 


»f the normal child in the dif- 
problems are discussed, with 
aling with them. 


CHOLOGY AND EDUCA- 


of Southern California. MeGraw- 


subject, including traditional 
vn a8 small-sample statistics. 
es interpretation of statistical 
statisties to serve as a hand- 
| biological sciences. 


il and Factual Study 


raw-Hill Publications in Psychology. 


nd objective basis than usual. 
| factual discoveries concerning 
‘ter discussing theorems on the 


ithor organizes what is known 


irning. Information from soci- 
| and psychosomatic relations 
anized in a review of the life 


roval 





McGRAW- HILL BOOK COMPANY, Inc. 


330 West 42nd Street 


New York 18,N.Y. 








